10/21/2024 02:01:24.719 7fcb0d2e9508 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 10/21/2024 02:01:24.723 7fcb0d2e9508 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 10/21/2024 02:01:24.735 7fcb0d2e9508 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 10/21/2024 02:01:24.736 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.30:2181 10/21/2024 02:01:24.736 7fcb0d2e9508 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:01:24.737 7fcb04056cc0 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 10/21/2024 02:01:24.737 7fcb04056cc0 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 10/21/2024 02:01:24.737 7fcb0405c630 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 10/21/2024 02:01:24.738 7fcb0405c630 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 10/21/2024 02:01:24.738 7fcb0405c630 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 10/21/2024 02:01:24.738 7fcb0405c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.738 7fcb0405c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 10/21/2024 02:01:24.739 7fcb0405c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.752 7fcb04080240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:24.752 7fcb04080240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 10/21/2024 02:01:24.752 7fcb04080240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:25.109 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.30:9041'] 10/21/2024 02:01:25.110 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 10/21/2024 02:01:25.110 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 10/21/2024 02:01:25.110 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 10/21/2024 02:01:25.111 7fcb04023c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:25.111 7fcb04023c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:01:25.111 7fcb04023c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:25.112 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 10/21/2024 02:01:26.214 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 10/21/2024 02:01:26.216 7fcb0403a978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:26.216 7fcb0403a978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:01:26.216 7fcb0403a978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:26.221 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 10/21/2024 02:01:26.221 7fcaff7a8828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:26.221 7fcaff7a8828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:01:26.222 7fcaff7a8828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:26.362 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:26.671 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid', created 10/21/2024 02:01:26.695 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:26.732 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:27.018 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 10/21/2024 02:01:27.027 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:27.066 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:27.288 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent', created 10/21/2024 02:01:27.307 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:27.324 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:27.593 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 10/21/2024 02:01:27.603 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:27.603 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 10/21/2024 02:01:28.029 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 10/21/2024 02:01:28.035 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:28.651 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_uuid_table', created 10/21/2024 02:01:28.656 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:28.662 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:28.738 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:29.253 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:01:29.258 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:29.265 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:29.745 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_fq_name_table', created 10/21/2024 02:01:29.753 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:29.783 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:30.078 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_fq_name_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:01:30.082 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:30.093 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:30.484 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table', created 10/21/2024 02:01:30.489 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:30.500 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:30.893 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:01:30.897 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:30.910 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:31.315 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table', created 10/21/2024 02:01:31.319 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:31.329 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 10/21/2024 02:01:31.551 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table' fixed with properties {'gc_grace_seconds': 864000} 10/21/2024 02:01:31.554 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 10/21/2024 02:01:31.682 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.30:5673//'] 10/21/2024 02:01:31.694 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 10/21/2024 02:01:33.749 7fcaff79feb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:33.749 7fcaff79feb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:33.749 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.749 7fcaff79feb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 10/21/2024 02:01:33.749 7fcaff79feb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.749 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:33.750 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:33.751 7fcaff79feb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:33.751 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:33.751 7fcaff79feb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:33.751 7fcaff79feb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:33.751 7fcaff79feb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:33.752 7fcaff79feb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 5 >> 10/21/2024 02:01:33.752 7fcaff79feb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:37.750 7fcaff758cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:42.752 7fcaff758cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:42.755 7fcaff758cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:42.756 7fcaff758cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:42.756 7fcaff758cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:42.756 7fcaff758cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:42.756 7fcaff758cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:42.757 7fcaff758cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:42.757 7fcaff758cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.757 7fcaff758cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:42.757 7fcaff758cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.757 7fcaff758cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:42.757 7fcaff758cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 5 >> 10/21/2024 02:01:42.758 7fcaff758cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.739 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 10/21/2024 02:01:43.741 7fcaff79aa20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.741 7fcaff79aa20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:43.742 7fcaff79aa20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.762 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 10/21/2024 02:01:43.763 7fcaff777588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.763 7fcaff777588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:43.764 7fcaff777588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.815 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 10/21/2024 02:01:43.816 7fcaff7778d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.818 7fcaff7778d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:43.818 7fcaff7778d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.820 7fcaff7778d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 10/21/2024 02:01:43.822 7fcaff797588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.822 7fcaff797588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 10/21/2024 02:01:43.822 7fcaff797588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.860 7fcaff7778d0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 10/21/2024 02:01:43.860 7fcaff79fa20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.861 7fcaff79fa20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:43.861 7fcaff79fa20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:43.952 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config']: Unknown id: global_system_config default-global-system-config 10/21/2024 02:01:43.962 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: global_system_config default-global-system-config 10/21/2024 02:01:44.069 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-global-vrouter-config']: Unknown id: global_vrouter_config default-global-system-config:default-global-vrouter-config 10/21/2024 02:01:44.069 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: global_vrouter_config default-global-system-config:default-global-vrouter-config 10/21/2024 02:01:44.144 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain']: Unknown id: domain default-domain 10/21/2024 02:01:44.145 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: domain default-domain 10/21/2024 02:01:44.336 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-fabric']: Unknown id: fabric default-global-system-config:default-fabric 10/21/2024 02:01:44.336 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: fabric default-global-system-config:default-fabric 10/21/2024 02:01:44.409 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-policy-management']: Unknown id: policy_management default-policy-management 10/21/2024 02:01:44.410 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: policy_management default-policy-management 10/21/2024 02:01:44.431 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-policy-management', 'default-application-policy-set']: Unknown id: application_policy_set default-policy-management:default-application-policy-set 10/21/2024 02:01:44.431 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: application_policy_set default-policy-management:default-application-policy-set 10/21/2024 02:01:44.496 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'ip-fabric']: Unknown id: virtual_network default-domain:default-project:ip-fabric 10/21/2024 02:01:44.496 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: virtual_network default-domain:default-project:ip-fabric 10/21/2024 02:01:44.586 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric']: Unknown id: routing_instance default-domain:default-project:ip-fabric:ip-fabric 10/21/2024 02:01:44.586 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:ip-fabric:ip-fabric 10/21/2024 02:01:44.657 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'ip-fabric', '__default__']: Unknown id: routing_instance default-domain:default-project:ip-fabric:__default__ 10/21/2024 02:01:44.658 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:ip-fabric:__default__ 10/21/2024 02:01:44.688 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', '__link_local__']: Unknown id: virtual_network default-domain:default-project:__link_local__ 10/21/2024 02:01:44.688 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: virtual_network default-domain:default-project:__link_local__ 10/21/2024 02:01:44.801 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', '__link_local__', '__link_local__']: Unknown id: routing_instance default-domain:default-project:__link_local__:__link_local__ 10/21/2024 02:01:44.802 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:__link_local__:__link_local__ 10/21/2024 02:01:44.843 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'dci-network']: Unknown id: virtual_network default-domain:default-project:dci-network 10/21/2024 02:01:44.844 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: virtual_network default-domain:default-project:dci-network 10/21/2024 02:01:44.949 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'dci-network', 'dci-network']: Unknown id: routing_instance default-domain:default-project:dci-network:dci-network 10/21/2024 02:01:44.949 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:dci-network:dci-network 10/21/2024 02:01:44.983 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'dci-network', '__default__']: Unknown id: routing_instance default-domain:default-project:dci-network:__default__ 10/21/2024 02:01:44.983 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:dci-network:__default__ 10/21/2024 02:01:45.246 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'system-defined-bottle-request-size-limit']: Unknown id: alarm default-global-system-config:system-defined-bottle-request-size-limit 10/21/2024 02:01:45.246 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-bottle-request-size-limit 10/21/2024 02:01:45.276 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network']: Unknown id: routing_instance default-domain:default-project:default-virtual-network:default-virtual-network 10/21/2024 02:01:45.277 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:default-virtual-network:default-virtual-network 10/21/2024 02:01:45.304 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', '__no_rule__']: Unknown id: security_group default-domain:default-project:__no_rule__ 10/21/2024 02:01:45.305 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: security_group default-domain:default-project:__no_rule__ 10/21/2024 02:01:45.363 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-discovery-service-assignment']: Unknown id: discovery_service_assignment default-discovery-service-assignment 10/21/2024 02:01:45.363 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: discovery_service_assignment default-discovery-service-assignment 10/21/2024 02:01:45.389 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-global-qos-config']: Unknown id: global_qos_config default-global-system-config:default-global-qos-config 10/21/2024 02:01:45.389 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: global_qos_config default-global-system-config:default-global-qos-config 10/21/2024 02:01:45.433 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'service-chain-flat-ipam']: Unknown id: network_ipam default-domain:default-project:service-chain-flat-ipam 10/21/2024 02:01:45.434 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: network_ipam default-domain:default-project:service-chain-flat-ipam 10/21/2024 02:01:45.460 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['label']: Unknown id: tag_type label 10/21/2024 02:01:45.460 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type label 10/21/2024 02:01:45.480 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['application']: Unknown id: tag_type application 10/21/2024 02:01:45.480 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type application 10/21/2024 02:01:45.512 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['tier']: Unknown id: tag_type tier 10/21/2024 02:01:45.512 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type tier 10/21/2024 02:01:45.539 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['deployment']: Unknown id: tag_type deployment 10/21/2024 02:01:45.540 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type deployment 10/21/2024 02:01:45.556 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['site']: Unknown id: tag_type site 10/21/2024 02:01:45.557 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type site 10/21/2024 02:01:45.578 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['neutron_fwaas']: Unknown id: tag_type neutron_fwaas 10/21/2024 02:01:45.578 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type neutron_fwaas 10/21/2024 02:01:45.626 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['neutron_tag']: Unknown id: tag_type neutron_tag 10/21/2024 02:01:45.627 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag_type neutron_tag 10/21/2024 02:01:45.644 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.30_0 10/21/2024 02:01:45.645 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly) 10/21/2024 02:01:45.661 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (None) 10/21/2024 02:01:45.661 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running dbe-resync 10/21/2024 02:01:45.679 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type tag_type len 7 10/21/2024 02:01:45.680 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for tag_type 10/21/2024 02:01:45.696 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for tag_type 10/21/2024 02:01:45.696 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_qos_config len 1 10/21/2024 02:01:45.696 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for global_qos_config 10/21/2024 02:01:45.702 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for global_qos_config 10/21/2024 02:01:45.702 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_system_config len 1 10/21/2024 02:01:45.702 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for global_system_config 10/21/2024 02:01:45.706 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for global_system_config 10/21/2024 02:01:45.706 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type routing_instance len 6 10/21/2024 02:01:45.707 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for routing_instance 10/21/2024 02:01:45.724 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for routing_instance 10/21/2024 02:01:45.724 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type virtual_network len 4 10/21/2024 02:01:45.724 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for virtual_network 10/21/2024 02:01:45.728 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Error in _create_default_rbac_rule: NoIdError: Unknown id: api_access_list default-global-system-config:default-api-access-list 10/21/2024 02:01:45.729 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 3949, in _create_default_rbac_rule id = self._db_conn.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: api_access_list default-global-system-config:default-api-access-list 10/21/2024 02:01:45.732 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-global-system-config', 'default-api-access-list']: Unknown id: api_access_list default-global-system-config:default-api-access-list 10/21/2024 02:01:45.732 7fcb0d2e9508 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: api_access_list default-global-system-config:default-api-access-list 10/21/2024 02:01:45.800 7fcaff7a4d68 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 10/21/2024 02:01:45.800 7fcaff59d780 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 10/21/2024 02:01:45.801 7fcaff59dac8 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 10/21/2024 02:01:45.802 7fcaff59dc18 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 10/21/2024 02:01:45.802 7fcb04023b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-virtual-network elements = { fq_name : ["default-domain", "default-project", "default-virtual-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17990843105182175065, "uuid_lslong": 13223927567551703771}, "enable": true, "created": "2024-10-21T02:01:44.280860", "last_modified": "2024-10-21T02:01:45.741073", "description": null, "user_visible": true, "creator": null}is_shared : falseparent_type : "project"parent_uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "f9ac507c-0e2b-4f59-b784-d40f2f6a2adb"virtual_network_network_id : 1 } deleted = False >> 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:dci-network elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "dci-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9900832399127757377, "uuid_lslong": 12342633656841261619}, "enable": true, "created": "2024-10-21T02:01:44.866815", "last_modified": "2024-10-21T02:01:45.742562", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falseis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "8966d29c-32b0-4241-ab49-d7eab4cdd233"virtual_network_category : "tenant"virtual_network_network_id : 4 } deleted = False >> 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:ip-fabric elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "ip-fabric"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2176240064620152898, "uuid_lslong": 12291023658403164959}, "enable": true, "created": "2024-10-21T02:01:44.524340", "last_modified": "2024-10-21T02:01:45.743717", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : trueis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "1e338ece-fda8-4842-aa92-7ce58d0af31f"virtual_network_category : "tenant"virtual_network_network_id : 2 } deleted = False >> 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.804 7fcb04023b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:__link_local__ elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "__link_local__"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12444801366212890389, "uuid_lslong": 12505674412700126827}, "enable": true, "created": "2024-10-21T02:01:44.712699", "last_modified": "2024-10-21T02:01:45.741932", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falseis_shared : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"parent_uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "acb4d0e8-3d6a-4f15-ad8d-149ed5aece6b"virtual_network_category : "tenant"virtual_network_network_id : 3 } deleted = False >> 10/21/2024 02:01:45.805 7fcb04023b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.805 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for virtual_network 10/21/2024 02:01:45.805 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type application_policy_set len 1 10/21/2024 02:01:45.805 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for application_policy_set 10/21/2024 02:01:45.821 7fcb0bed7780 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 10/21/2024 02:01:45.822 7fcaff79f240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.822 7fcaff79f240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "d79c093b-654c-4581-b879-8f6d131b2fd5"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13988474135015736924, "uuid_lslong": 11963689190619294104}, "enable": true, "created": "2024-10-21T02:01:44.446517", "last_modified": "2024-10-21T02:01:44.463969", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "e33f1190-c882-42f9-bcb1-7b5490ccbeaa"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c2210b1c-975a-465c-a607-8feeba0b2998" } deleted = False >> 10/21/2024 02:01:45.822 7fcaff79f240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.822 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for application_policy_set 10/21/2024 02:01:45.823 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type global_vrouter_config len 1 10/21/2024 02:01:45.823 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for global_vrouter_config 10/21/2024 02:01:45.832 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for global_vrouter_config 10/21/2024 02:01:45.832 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type fabric len 1 10/21/2024 02:01:45.832 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for fabric 10/21/2024 02:01:45.836 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for fabric 10/21/2024 02:01:45.836 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type domain len 1 10/21/2024 02:01:45.836 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for domain 10/21/2024 02:01:45.868 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for domain 10/21/2024 02:01:45.868 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type network_ipam len 2 10/21/2024 02:01:45.868 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for network_ipam 10/21/2024 02:01:45.878 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for network_ipam 10/21/2024 02:01:45.879 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type discovery_service_assignment len 1 10/21/2024 02:01:45.879 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for discovery_service_assignment 10/21/2024 02:01:45.884 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for discovery_service_assignment 10/21/2024 02:01:45.885 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type policy_management len 1 10/21/2024 02:01:45.885 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for policy_management 10/21/2024 02:01:45.892 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for policy_management 10/21/2024 02:01:45.899 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type security_group len 1 10/21/2024 02:01:45.899 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for security_group 10/21/2024 02:01:45.905 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for security_group 10/21/2024 02:01:45.905 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type project len 1 10/21/2024 02:01:45.905 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for project 10/21/2024 02:01:45.921 7fcaff5458d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Entry not found in Cassandra or ZooKeeper for ['default-domain', 'default-project', 'default-application-policy-set']: Unknown id: application_policy_set default-domain:default-project:default-application-policy-set 10/21/2024 02:01:45.921 7fcaff5458d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4006, in create_singleton_entry cass_uuid = self._db_conn._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: application_policy_set default-domain:default-project:default-application-policy-set 10/21/2024 02:01:45.954 7fcaff56f438 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 10/21/2024 02:01:45.954 7fcaff699d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.954 7fcaff699d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14356279724061770126, "uuid_lslong": 12144271998468869743}, "enable": true, "created": "2024-10-21T02:01:44.199908", "last_modified": "2024-10-21T02:01:44.199908", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "7708a312-0796-4efe-a074-f3667a87baf2"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f" } deleted = False >> 10/21/2024 02:01:45.954 7fcaff699d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:45.956 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for project 10/21/2024 02:01:45.956 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type namespace len 1 10/21/2024 02:01:45.956 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for namespace 10/21/2024 02:01:45.961 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for namespace 10/21/2024 02:01:45.962 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DB walk: obj_type alarm len 1 10/21/2024 02:01:45.962 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Start DB Resync for alarm 10/21/2024 02:01:45.967 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Finished DB Resync for alarm 10/21/2024 02:01:45.972 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: Completed successfully 10/21/2024 02:01:45.975 7fcaff6ac978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 10/21/2024 02:01:46.001 7fcaff6ac978 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Time elapsed in resyncing db: 0:00:00.355986 10/21/2024 02:01:46.004 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'obj_dict': {'autonomous_system': 64512, 'config_version': '1.0', 'enable_4byte_as': False, 'enable_security_policy_draft': False, 'fq_name': ['default-global-system-config'], 'ibgp_auto_mesh': True, 'id_perms': {'created': '2024-10-21T02:01:43.993455', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:43.993455', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13332124365054503304, 'uuid_mslong': 10753830932495682174}}, 'igmp_enable': False, 'mac_aging_time': 300, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '953d4841-c203-4a7e-b905-387930676988'}, 'oper': 'CREATE', 'request-id': 'req-641356df-2522-458e-8034-dcd8f9455ea9', 'type': 'global_system_config', 'uuid': '953d4841-c203-4a7e-b905-387930676988'} 10/21/2024 02:01:46.006 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'obj_dict': {'enable_security_logging': True, 'encryption_mode': 'none', 'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'id_perms': {'created': '2024-10-21T02:01:44.116718', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.116718', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13292813473795485653, 'uuid_mslong': 15536302965228586369}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd79c093b-654c-4581-b879-8f6d131b2fd5'}, 'oper': 'CREATE', 'request-id': 'req-0fbfc7d0-ac8f-4faa-8d92-2872b64ac2fc', 'type': 'global_vrouter_config', 'uuid': 'd79c093b-654c-4581-b879-8f6d131b2fd5'} 10/21/2024 02:01:46.007 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain'], 'obj_dict': {'fq_name': ['default-domain'], 'id_perms': {'created': '2024-10-21T02:01:44.155820', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.155820', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11562133764834835186, 'uuid_mslong': 8577284788159139582}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7708a312-0796-4efe-a074-f3667a87baf2'}, 'oper': 'CREATE', 'request-id': 'req-b260aaef-8222-4db9-bdc3-cae5fbbe79ee', 'type': 'domain', 'uuid': '7708a312-0796-4efe-a074-f3667a87baf2'} 10/21/2024 02:01:46.009 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'obj_dict': {'_enable_security_policy_draft': False, '_type': 'project', '_uuid': None, 'fq_name': ['default-domain', 'default-project'], 'id_perms': {'created': '2024-10-21T02:01:44.199908', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.199908', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12144271998468869743, 'uuid_mslong': 14356279724061770126}}, 'name': 'default-project', 'parent_type': 'domain', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f'}, 'oper': 'CREATE', 'request-id': 'req-00ffad4b-05bf-44c9-af49-d5317df7928b', 'type': 'project', 'uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f'} 10/21/2024 02:01:46.010 7fcaff758240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.012 7fcaff758240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { _enable_security_policy_draft : false_type : "project"_uuid : nullfq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14356279724061770126, "uuid_lslong": 12144271998468869743}, "enable": true, "created": "2024-10-21T02:01:44.199908", "last_modified": "2024-10-21T02:01:44.199908", "description": null, "user_visible": true, "creator": null}name : "default-project"parent_type : "domain"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f" } deleted = False >> 10/21/2024 02:01:46.012 7fcaff758240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.014 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'obj_dict': {'_type': 'network-ipam', '_uuid': None, 'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'id_perms': {'created': '2024-10-21T02:01:44.231162', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.231162', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10433939240412988190, 'uuid_mslong': 17700259682276230384}}, 'name': 'default-network-ipam', 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f5a3f466-aa3e-44f0-90cc-cc7530d3431e'}, 'oper': 'CREATE', 'request-id': 'req-37440cd1-4dab-4f74-bce0-d1dfe1dac079', 'type': 'network_ipam', 'uuid': 'f5a3f466-aa3e-44f0-90cc-cc7530d3431e'} 10/21/2024 02:01:46.018 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network'], 'obj_dict': {'_fabric_snat': False, '_flood_unknown_unicast': False, '_igmp_enable': False, '_is_provider_network': False, '_layer2_control_word': False, '_mac_aging_time': 300, '_mac_ip_learning_enable': False, '_mac_learning_enabled': False, '_pbb_etree_enable': False, '_pbb_evpn_enable': False, '_port_security_enabled': True, '_type': 'virtual-network', '_uuid': None, '_virtual_network_category': 'tenant', 'fq_name': ['default-domain', 'default-project', 'default-virtual-network'], 'id_perms': {'created': '2024-10-21T02:01:44.280860', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.280860', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13223927567551703771, 'uuid_mslong': 17990843105182175065}}, 'name': 'default-virtual-network', 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f9ac507c-0e2b-4f59-b784-d40f2f6a2adb', 'virtual_network_network_id': 1}, 'oper': 'CREATE', 'request-id': 'req-85b4b24c-44ce-4755-a175-e0e0b090b1f9', 'type': 'virtual_network', 'uuid': 'f9ac507c-0e2b-4f59-b784-d40f2f6a2adb'} 10/21/2024 02:01:46.030 7fcb0a88a438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.031 7fcb0a88a438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-virtual-network elements = { _fabric_snat : false_flood_unknown_unicast : false_igmp_enable : false_is_provider_network : false_layer2_control_word : false_mac_aging_time : 300_mac_ip_learning_enable : false_mac_learning_enabled : false_pbb_etree_enable : false_pbb_evpn_enable : false_port_security_enabled : true_type : "virtual-network"_uuid : null_virtual_network_category : "tenant"fq_name : ["default-domain", "default-project", "default-virtual-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 17990843105182175065, "uuid_lslong": 13223927567551703771}, "enable": true, "created": "2024-10-21T02:01:44.280860", "last_modified": "2024-10-21T02:01:44.280860", "description": null, "user_visible": true, "creator": null}name : "default-virtual-network"parent_type : "project"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "f9ac507c-0e2b-4f59-b784-d40f2f6a2adb"virtual_network_network_id : 1 } deleted = False >> 10/21/2024 02:01:46.031 7fcb0a88a438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.044 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-namespace'], 'obj_dict': {'_type': 'namespace', '_uuid': None, 'fq_name': ['default-domain', 'default-namespace'], 'id_perms': {'created': '2024-10-21T02:01:44.318115', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.318115', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13159416331025505937, 'uuid_mslong': 9231907929775951819}}, 'name': 'default-namespace', 'parent_type': 'domain', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '801e5359-7168-4fcb-b69f-a36e763fde91'}, 'oper': 'CREATE', 'request-id': 'req-ab360136-cd1e-412c-8338-e6c1ee158830', 'type': 'namespace', 'uuid': '801e5359-7168-4fcb-b69f-a36e763fde91'} 10/21/2024 02:01:46.049 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-fabric'], 'obj_dict': {'disable_vlan_vn_uniqueness_check': False, 'fabric_enterprise_style': True, 'fq_name': ['default-global-system-config', 'default-fabric'], 'id_perms': {'created': '2024-10-21T02:01:44.389902', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.389902', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10704224272920594112, 'uuid_mslong': 15591267641930498505}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd85f4f50-734f-41c9-948d-0b43478bc6c0'}, 'oper': 'CREATE', 'request-id': 'req-312c4329-6300-462e-976d-f328c7f8eb1c', 'type': 'fabric', 'uuid': 'd85f4f50-734f-41c9-948d-0b43478bc6c0'} 10/21/2024 02:01:46.055 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management'], 'obj_dict': {'fq_name': ['default-policy-management'], 'id_perms': {'created': '2024-10-21T02:01:44.422451', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.422451', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13596784353145044650, 'uuid_mslong': 16374826083679355641}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e33f1190-c882-42f9-bcb1-7b5490ccbeaa'}, 'oper': 'CREATE', 'request-id': 'req-4524e6fb-aa95-48f8-b711-4414aecac4f3', 'type': 'policy_management', 'uuid': 'e33f1190-c882-42f9-bcb1-7b5490ccbeaa'} 10/21/2024 02:01:46.081 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'fq_name': ['default-policy-management', 'default-application-policy-set'], 'id_perms': {'created': '2024-10-21T02:01:44.446517', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.446517', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11963689190619294104, 'uuid_mslong': 13988474135015736924}}, 'parent_type': 'policy-management', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c2210b1c-975a-465c-a607-8feeba0b2998'}, 'oper': 'CREATE', 'request-id': 'req-4228aeea-730c-452a-9812-d7653897d6fa', 'type': 'application_policy_set', 'uuid': 'c2210b1c-975a-465c-a607-8feeba0b2998'} 10/21/2024 02:01:46.091 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-871c9126-88dd-4c3b-8d13-ca79555b307f', 'type': 'application_policy_set', 'uuid': 'c2210b1c-975a-465c-a607-8feeba0b2998'} 10/21/2024 02:01:46.097 7fcb0a88a438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.099 7fcb0a88a438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13988474135015736924, "uuid_lslong": 11963689190619294104}, "enable": true, "created": "2024-10-21T02:01:44.446517", "last_modified": "2024-10-21T02:01:44.446517", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c2210b1c-975a-465c-a607-8feeba0b2998" } deleted = False >> 10/21/2024 02:01:46.101 7fcb0a88a438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.121 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', 'ip-fabric'], 'id_perms': {'created': '2024-10-21T02:01:44.524340', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.524340', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12291023658403164959, 'uuid_mslong': 2176240064620152898}}, 'igmp_enable': False, 'is_provider_network': True, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': '1e338ece-fda8-4842-aa92-7ce58d0af31f', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 2}, 'oper': 'CREATE', 'request-id': 'req-6711948c-dc07-46b9-9ab3-3d8e6e4f8e6a', 'type': 'virtual_network', 'uuid': '1e338ece-fda8-4842-aa92-7ce58d0af31f'} 10/21/2024 02:01:46.126 7fcaff7a4ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.139 7fcaff7a4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "d79c093b-654c-4581-b879-8f6d131b2fd5"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 13988474135015736924, "uuid_lslong": 11963689190619294104}, "enable": true, "created": "2024-10-21T02:01:44.446517", "last_modified": "2024-10-21T02:01:44.463969", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "e33f1190-c882-42f9-bcb1-7b5490ccbeaa"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "c2210b1c-975a-465c-a607-8feeba0b2998" } deleted = False >> 10/21/2024 02:01:46.139 7fcaff7a4ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.139 7fcaff7a4ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.140 7fcaff7a4ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:ip-fabric elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "ip-fabric"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2176240064620152898, "uuid_lslong": 12291023658403164959}, "enable": true, "created": "2024-10-21T02:01:44.524340", "last_modified": "2024-10-21T02:01:44.524340", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : truelayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "1e338ece-fda8-4842-aa92-7ce58d0af31f"virtual_network_category : "tenant"virtual_network_network_id : 2 } deleted = False >> 10/21/2024 02:01:46.140 7fcaff7a4ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.181 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2024-10-21T02:01:44.642229', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.642229', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12139511686763666415, 'uuid_mslong': 339177537015925746}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '04b5002c-41a0-4bf2-a878-358fac405bef'}, 'oper': 'CREATE', 'request-id': 'req-36469ca8-5f46-481d-8510-318c14328577', 'type': 'routing_instance', 'uuid': '04b5002c-41a0-4bf2-a878-358fac405bef'} 10/21/2024 02:01:46.189 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__'], 'id_perms': {'created': '2024-10-21T02:01:44.675498', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.675498', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12136616060349460284, 'uuid_mslong': 2583166731877697890}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': False, 'uuid': '23d94074-d92d-4962-a86d-ec011c6e2f3c'}, 'oper': 'CREATE', 'request-id': 'req-fef74e47-77cc-4694-baff-ec704b06b8a5', 'type': 'routing_instance', 'uuid': '23d94074-d92d-4962-a86d-ec011c6e2f3c'} 10/21/2024 02:01:46.191 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__link_local__'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', '__link_local__'], 'id_perms': {'created': '2024-10-21T02:01:44.712699', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.712699', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12505674412700126827, 'uuid_mslong': 12444801366212890389}}, 'igmp_enable': False, 'is_provider_network': False, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': 'acb4d0e8-3d6a-4f15-ad8d-149ed5aece6b', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 3}, 'oper': 'CREATE', 'request-id': 'req-1892c8da-4475-4899-8bce-3f737d839577', 'type': 'virtual_network', 'uuid': 'acb4d0e8-3d6a-4f15-ad8d-149ed5aece6b'} 10/21/2024 02:01:46.193 7fcaff56f438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.193 7fcaff56f438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:__link_local__ elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "__link_local__"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 12444801366212890389, "uuid_lslong": 12505674412700126827}, "enable": true, "created": "2024-10-21T02:01:44.712699", "last_modified": "2024-10-21T02:01:44.712699", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "acb4d0e8-3d6a-4f15-ad8d-149ed5aece6b"virtual_network_category : "tenant"virtual_network_network_id : 3 } deleted = False >> 10/21/2024 02:01:46.193 7fcaff56f438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.199 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__link_local__', '__link_local__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', '__link_local__', '__link_local__'], 'id_perms': {'created': '2024-10-21T02:01:44.822310', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.822310', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12546596415255476349, 'uuid_mslong': 17797934187678548289}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': 'f6fef6d8-a05c-4141-ae1e-76f7077df87d'}, 'oper': 'CREATE', 'request-id': 'req-85ff6cec-6cd1-47bd-9599-5a27f095410d', 'type': 'routing_instance', 'uuid': 'f6fef6d8-a05c-4141-ae1e-76f7077df87d'} 10/21/2024 02:01:46.201 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network'], 'obj_dict': {'fabric_snat': False, 'flood_unknown_unicast': False, 'fq_name': ['default-domain', 'default-project', 'dci-network'], 'id_perms': {'created': '2024-10-21T02:01:44.866815', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.866815', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12342633656841261619, 'uuid_mslong': 9900832399127757377}}, 'igmp_enable': False, 'is_provider_network': False, 'layer2_control_word': False, 'mac_aging_time': 300, 'mac_ip_learning_enable': False, 'mac_learning_enabled': False, 'parent_type': 'project', 'pbb_etree_enable': False, 'pbb_evpn_enable': False, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'port_security_enabled': True, 'uuid': '8966d29c-32b0-4241-ab49-d7eab4cdd233', 'virtual_network_category': 'tenant', 'virtual_network_network_id': 4}, 'oper': 'CREATE', 'request-id': 'req-d4c4862e-6488-478c-8655-c449e12aec04', 'type': 'virtual_network', 'uuid': '8966d29c-32b0-4241-ab49-d7eab4cdd233'} 10/21/2024 02:01:46.202 7fcaff56f438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.202 7fcaff56f438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:dci-network elements = { fabric_snat : falseflood_unknown_unicast : falsefq_name : ["default-domain", "default-project", "dci-network"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9900832399127757377, "uuid_lslong": 12342633656841261619}, "enable": true, "created": "2024-10-21T02:01:44.866815", "last_modified": "2024-10-21T02:01:44.866815", "description": null, "user_visible": true, "creator": null}igmp_enable : falseis_provider_network : falselayer2_control_word : falsemac_aging_time : 300mac_ip_learning_enable : falsemac_learning_enabled : falseparent_type : "project"pbb_etree_enable : falsepbb_evpn_enable : falseperms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}port_security_enabled : trueuuid : "8966d29c-32b0-4241-ab49-d7eab4cdd233"virtual_network_category : "tenant"virtual_network_network_id : 4 } deleted = False >> 10/21/2024 02:01:46.203 7fcaff56f438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.206 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'id_perms': {'created': '2024-10-21T02:01:44.969842', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:44.969842', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12578460170797752559, 'uuid_mslong': 3367017704519585177}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '2eba0cc3-5657-4d99-ae8f-aae1bdcca0ef'}, 'oper': 'CREATE', 'request-id': 'req-31784285-71b5-4df2-9c4c-3a8cfbd7e295', 'type': 'routing_instance', 'uuid': '2eba0cc3-5657-4d99-ae8f-aae1bdcca0ef'} 10/21/2024 02:01:46.208 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'id_perms': {'created': '2024-10-21T02:01:45.226275', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.226275', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11011559460865621062, 'uuid_mslong': 1875049462252062884}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': False, 'uuid': '1a05838d-2dd2-48a4-98d0-eafce7fcbc46'}, 'oper': 'CREATE', 'request-id': 'req-a1e870fe-4f2d-48ed-843d-f5b93652b95d', 'type': 'routing_instance', 'uuid': '1a05838d-2dd2-48a4-98d0-eafce7fcbc46'} 10/21/2024 02:01:46.210 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bottle-request-size-limit'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'UveConfigReq.err_info.*.', 'operand2': {'json_value': 'True'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'fq_name': ['default-global-system-config', 'system-defined-bottle-request-size-limit'], 'id_perms': {'created': '2024-10-21T02:01:45.264160', 'description': 'Bottle request size limit exceeded.', 'last_modified': '2024-10-21T02:01:45.264160', 'uuid': {'uuid_lslong': 11037134238139147826, 'uuid_mslong': 1219228119074359367}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '10eb9183-b998-4847-992b-c71cc295e632', 'uve_keys': {'uve_key': ['config-node']}}, 'oper': 'CREATE', 'request-id': 'req-69cd1537-935e-482f-95a4-d348509c54e8', 'type': 'alarm', 'uuid': '10eb9183-b998-4847-992b-c71cc295e632'} 10/21/2024 02:01:46.212 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'id_perms': {'created': '2024-10-21T02:01:45.294055', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.294055', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10149835425203183727, 'uuid_mslong': 10272769395026905379}}, 'parent_type': 'virtual-network', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '8e903556-5a15-4923-8cdb-758b07e9606f'}, 'oper': 'CREATE', 'request-id': 'req-734846ad-81cd-45db-9d98-8f2b459650fe', 'type': 'routing_instance', 'uuid': '8e903556-5a15-4923-8cdb-758b07e9606f'} 10/21/2024 02:01:46.213 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__'], 'obj_dict': {'configured_security_group_id': 0, 'fq_name': ['default-domain', 'default-project', '__no_rule__'], 'id_perms': {'created': '2024-10-21T02:01:45.344304', 'creator': None, 'description': 'Security group with no rules', 'enable': True, 'last_modified': '2024-10-21T02:01:45.344304', 'permissions': None, 'user_visible': True, 'uuid': {'uuid_lslong': 11012986174475371247, 'uuid_mslong': 6195171020473255058}}, 'parent_type': 'project', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'security_group_entries': {'policy_rule': []}, 'security_group_id': 8000001, 'uuid': '55f9ab38-3e1a-4492-98d5-fc938de482ef'}, 'oper': 'CREATE', 'request-id': 'req-ac0022cf-5b13-49b0-b08e-f56b8a07edc8', 'type': 'security_group', 'uuid': '55f9ab38-3e1a-4492-98d5-fc938de482ef'} 10/21/2024 02:01:46.217 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-discovery-service-assignment'], 'obj_dict': {'fq_name': ['default-discovery-service-assignment'], 'id_perms': {'created': '2024-10-21T02:01:45.374493', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.374493', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13431487631875616238, 'uuid_mslong': 4264734177799523387}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3b2f6123-a135-4c3b-ba66-3ad68effadee'}, 'oper': 'CREATE', 'request-id': 'req-cafc06c2-fd6e-4571-9538-c4d6ced4c382', 'type': 'discovery_service_assignment', 'uuid': '3b2f6123-a135-4c3b-ba66-3ad68effadee'} 10/21/2024 02:01:46.218 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-qos-config'], 'obj_dict': {'fq_name': ['default-global-system-config', 'default-global-qos-config'], 'id_perms': {'created': '2024-10-21T02:01:45.415273', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.415273', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9327131087998771147, 'uuid_mslong': 12799282655394154213}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b1a02fc2-f696-46e5-8170-a04ea9ab5fcb'}, 'oper': 'CREATE', 'request-id': 'req-eaa664de-857b-4ed3-9369-991593d3fd04', 'type': 'global_qos_config', 'uuid': 'b1a02fc2-f696-46e5-8170-a04ea9ab5fcb'} 10/21/2024 02:01:46.221 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'service-chain-flat-ipam'], 'obj_dict': {'fq_name': ['default-domain', 'default-project', 'service-chain-flat-ipam'], 'id_perms': {'created': '2024-10-21T02:01:45.450784', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.450784', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13314762210602754032, 'uuid_mslong': 17574546256520695214}}, 'ipam_subnet_method': 'flat-subnet', 'ipam_subnets': {'subnets': [{'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': None, 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': None, 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '0.0.0.0', 'ip_prefix_len': 8}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}, {'addr_from_start': None, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': None, 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': None, 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': '::ffff', 'ip_prefix_len': 104}, 'subnet_name': None, 'subnet_uuid': None, 'subscriber_tag': None, 'vlan_tag': None}]}, 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f3e554b4-d496-4dae-b8c7-89af97c59ff0'}, 'oper': 'CREATE', 'request-id': 'req-7286c770-5327-4ce4-adfa-b488be2f081c', 'type': 'network_ipam', 'uuid': 'f3e554b4-d496-4dae-b8c7-89af97c59ff0'} 10/21/2024 02:01:46.227 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label'], 'obj_dict': {'display_name': 'label', 'fq_name': ['label'], 'id_perms': {'created': '2024-10-21T02:01:45.469809', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.469809', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 9468798038548839625, 'uuid_mslong': 11495298651689665802}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0000', 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}, 'oper': 'CREATE', 'request-id': 'req-0aa24446-2120-4773-b2b4-c79455244c0f', 'type': 'tag_type', 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'} 10/21/2024 02:01:46.229 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['application'], 'obj_dict': {'display_name': 'application', 'fq_name': ['application'], 'id_perms': {'created': '2024-10-21T02:01:45.497839', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.497839', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 10458326991423079618, 'uuid_mslong': 17606239290808291243}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0001', 'uuid': 'f455ed5a-6727-4fab-9123-70fcf4a704c2'}, 'oper': 'CREATE', 'request-id': 'req-59a397fd-bce6-4424-ad16-f0a5960b384a', 'type': 'tag_type', 'uuid': 'f455ed5a-6727-4fab-9123-70fcf4a704c2'} 10/21/2024 02:01:46.341 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['tier'], 'obj_dict': {'display_name': 'tier', 'fq_name': ['tier'], 'id_perms': {'created': '2024-10-21T02:01:45.530819', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.530819', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 11656891331243166527, 'uuid_mslong': 17633899417897747919}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0002', 'uuid': 'f4b83217-98c3-45cf-a1c5-98e7a8144b3f'}, 'oper': 'CREATE', 'request-id': 'req-658420fe-42fd-45cd-b816-bd89b4beaf8b', 'type': 'tag_type', 'uuid': 'f4b83217-98c3-45cf-a1c5-98e7a8144b3f'} 10/21/2024 02:01:46.342 7fcb0d2e9508 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 10/21/2024 02:01:46.344 7fcaff7ebeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.345 7fcaff7ebeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ModuleCpuStateTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 build_info = {"build-info" : [{"build-version" : "nightly", "build-time" : "2024-10-21 00:37:15.234825", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-6068-1.novalocal", "build-id" : "nightly-nightly.el7", "build-number" : "@contrail"}]} config_node_ip = [ 10.0.0.30, 252.30.0.1, 10.25.16.1, 172.17.0.1, ] >> 10/21/2024 02:01:46.345 7fcaff7ebeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.473 7fcaff521d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.474 7fcaff521d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 10/21/2024 02:01:46.474 7fcaff521d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.484 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Starting consumer greenlet 10/21/2024 02:01:46.484 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:46.485 7fcaff27f2e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Starting publisher greenlet 10/21/2024 02:01:46.485 7fcaff27f2e8 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Publisher connection 10/21/2024 02:01:46.487 7fcb0d2e9508 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-juju-os-439-1.dummy 10/21/2024 02:01:46.487 7fcb0d2e9508 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:01:46.490 7fcb057e1588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.490 7fcb057e1588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = https://10.0.0.30:8084 >> 10/21/2024 02:01:46.490 7fcb057e1588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.505 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['deployment'], 'obj_dict': {'display_name': 'deployment', 'fq_name': ['deployment'], 'id_perms': {'created': '2024-10-21T02:01:45.548877', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.548877', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12545160707441435658, 'uuid_mslong': 972933349915838797}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0003', 'uuid': '0d808dba-17dd-494d-ae19-5d32413c240a'}, 'oper': 'CREATE', 'request-id': 'req-bd5ab32b-d672-4a38-808a-4d149ccb39fb', 'type': 'tag_type', 'uuid': '0d808dba-17dd-494d-ae19-5d32413c240a'} 10/21/2024 02:01:46.535 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['site'], 'obj_dict': {'display_name': 'site', 'fq_name': ['site'], 'id_perms': {'created': '2024-10-21T02:01:45.565649', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.565649', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12611471199196061157, 'uuid_mslong': 16433200998978240609}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0004', 'uuid': 'e40e753d-e2b1-4061-af04-f23cbb269de5'}, 'oper': 'CREATE', 'request-id': 'req-1872647d-1b0d-415e-91e9-8bf23a74bd07', 'type': 'tag_type', 'uuid': 'e40e753d-e2b1-4061-af04-f23cbb269de5'} 10/21/2024 02:01:46.550 7fcaff27f198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:46.551 7fcaff27f2e8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 10/21/2024 02:01:46.559 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['neutron_fwaas'], 'obj_dict': {'display_name': 'neutron_fwaas', 'fq_name': ['neutron_fwaas'], 'id_perms': {'created': '2024-10-21T02:01:45.606480', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.606480', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 11639151067030569504, 'uuid_mslong': 1152513257961309381}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0005', 'uuid': '0ffe8cb3-abb6-44c5-a186-923a85774220'}, 'oper': 'CREATE', 'request-id': 'req-ca9561c4-b6e7-4ab1-bb5f-0f38dc74b7d1', 'type': 'tag_type', 'uuid': '0ffe8cb3-abb6-44c5-a186-923a85774220'} 10/21/2024 02:01:46.562 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['neutron_tag'], 'obj_dict': {'display_name': 'neutron_tag', 'fq_name': ['neutron_tag'], 'id_perms': {'created': '2024-10-21T02:01:45.636390', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.636390', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': False, 'uuid': {'uuid_lslong': 12247483707036313207, 'uuid_mslong': 17130276437036515461}}, 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'tag_type_id': '0x0006', 'uuid': 'edbaf7a8-cdce-4085-a9f7-cd8aa648a677'}, 'oper': 'CREATE', 'request-id': 'req-741dd6d2-b82b-4f29-8d96-1e6142c60738', 'type': 'tag_type', 'uuid': 'edbaf7a8-cdce-4085-a9f7-cd8aa648a677'} 10/21/2024 02:01:46.566 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-afae4313-bfc0-4cdf-a758-eb0cf6148a37', 'type': 'network_ipam', 'uuid': 'f5a3f466-aa3e-44f0-90cc-cc7530d3431e'} 10/21/2024 02:01:46.569 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-juju-os-439-1.dummy'] 10/21/2024 02:01:46.579 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Ensuring Consumer connection 10/21/2024 02:01:46.594 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-api-access-list'], 'obj_dict': {'api_access_list_entries': {'rbac_rule': [{'rule_field': '', 'rule_object': 'fqname-to-id', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'id-to-fqname', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'useragent-kv', 'rule_perms': [{'role_crud': 'CRUD', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'documentation', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': '/', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': '', 'rule_object': 'watch', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}, {'rule_field': 'logical_router_gateway_external', 'rule_object': 'logical-router', 'rule_perms': [{'role_crud': 'R', 'role_name': '*'}]}]}, 'fq_name': ['default-global-system-config', 'default-api-access-list'], 'id_perms': {'created': '2024-10-21T02:01:45.808124', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.808124', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10261451477292667891, 'uuid_mslong': 11294567033329241037}}, 'parent_type': 'global-system-config', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9cbe5ce0-296d-4bcd-8e67-ffc047efd3f3'}, 'oper': 'CREATE', 'request-id': 'req-6b8c6614-3013-47a4-aa27-e5c59fdd3f8e', 'type': 'api_access_list', 'uuid': '9cbe5ce0-296d-4bcd-8e67-ffc047efd3f3'} 10/21/2024 02:01:46.596 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-application-policy-set'], 'obj_dict': {'all_applications': True, 'fq_name': ['default-domain', 'default-project', 'default-application-policy-set'], 'id_perms': {'created': '2024-10-21T02:01:45.946313', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:45.946313', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13608342810567422055, 'uuid_mslong': 11253540094782685275}}, 'parent_type': 'project', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9c2c9b17-a723-405b-bcda-8bafa59cb067'}, 'oper': 'CREATE', 'request-id': 'req-c09bcdbf-a261-4dd8-87a5-e70513711b61', 'type': 'application_policy_set', 'uuid': '9c2c9b17-a723-405b-bcda-8bafa59cb067'} 10/21/2024 02:01:46.597 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 10/21/2024 02:01:46.598 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-2b88ecc0-cba5-411d-b337-b87f92acbed2', 'type': 'project', 'uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f'} 10/21/2024 02:01:46.600 7fcaff0c6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.600 7fcaff0c6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:default-application-policy-set elements = { all_applications : truefq_name : ["default-domain", "default-project", "default-application-policy-set"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 11253540094782685275, "uuid_lslong": 13608342810567422055}, "enable": true, "created": "2024-10-21T02:01:45.946313", "last_modified": "2024-10-21T02:01:45.946313", "description": null, "user_visible": true, "creator": null}parent_type : "project"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "9c2c9b17-a723-405b-bcda-8bafa59cb067" } deleted = False >> 10/21/2024 02:01:46.600 7fcaff0c6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.609 7fcaff0c8978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.609 7fcaff0c8978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14356279724061770126, "uuid_lslong": 12144271998468869743}, "enable": true, "created": "2024-10-21T02:01:44.199908", "last_modified": "2024-10-21T02:01:45.994406", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "7708a312-0796-4efe-a074-f3667a87baf2"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f" } deleted = False >> 10/21/2024 02:01:46.610 7fcaff0c8978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:46.693 7fcaff27f198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 10/21/2024 02:01:46.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-juju-os-439-1.dummy'] 10/21/2024 02:01:46.753 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:47.717 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:47.717 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:47.717 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:47.717 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:47.718 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:47.718 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:47.718 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:47.719 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:47.719 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:47.719 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:47.719 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:47.721 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:47.722 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:47.723 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:47.723 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:47.723 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:47.723 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:47.723 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:47.723 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:47.724 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:47.725 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:47.725 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:47.725 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:47.726 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:47.727 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:47.727 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:47.727 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:47.728 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:47.728 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:47.728 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:47.729 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:47.730 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:47.731 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:47.732 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:47.732 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:47.732 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:47.732 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:47.732 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:47.733 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 10/21/2024 02:01:47.733 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:01:47.733 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:47.733 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:47.735 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:47.735 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:47.738 7fcaff6acc18 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Object UUID cache manager: set cache already there, before last modified: 1729476103993902 and meta row: 0 after last modified: 1729476103993902 and meta row: 0 10/21/2024 02:01:47.738 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:47.739 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:47.740 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:47.740 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:47.740 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:47.740 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:47.740 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:47.740 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:47.755 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:47.755 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:47.755 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:47.755 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:47.756 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:47.756 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:47.756 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:47.756 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:47.756 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:47.757 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:47.759 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:47.760 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:47.763 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:47.763 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:47.763 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:47.763 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:47.763 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:47.764 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:47.765 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:47.765 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:47.765 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:47.765 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:47.765 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:47.765 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:47.767 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:47.767 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:47.767 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:47.767 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:47.767 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:47.768 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:47.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:47.849 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: analytics_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:47.850 7fcaff699828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: analytics_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:47.864 7fcaff1aab70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:47.864 7fcaff1aab70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.30 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:47.885 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: config_database_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:47.885 7fcaff6acc18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: config_database_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:47.907 7fcaff0c80f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:47.925 7fcaff0c80f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/config-database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_config_database_node.py remote_ip = 10.0.0.30 body = {"config-database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "config_database_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:48.029 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:48.004211', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:48.004211', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13467223589024588416, 'uuid_mslong': 16185923586763869294}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e09ff3be-d6ad-4c6e-bae5-308076926280'}, 'oper': 'CREATE', 'request-id': 'req-52a37386-41c7-4a5a-910b-10686897a0ae', 'type': 'analytics_node', 'uuid': 'e09ff3be-d6ad-4c6e-bae5-308076926280'} 10/21/2024 02:01:48.030 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 10/21/2024 02:01:48.045 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:48.021613', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:48.021613', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10216356784971280132, 'uuid_mslong': 6474114911615929874}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '59d8ad35-f5ed-4e12-8dc7-ca5e0add6f04'}, 'oper': 'CREATE', 'request-id': 'req-1c2f77dd-115c-4e28-aefa-24dffef36c7f', 'type': 'config_database_node', 'uuid': '59d8ad35-f5ed-4e12-8dc7-ca5e0add6f04'} 10/21/2024 02:01:48.046 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 10/21/2024 02:01:48.542 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'image_upgrade_template'] not found in DB: Unknown id: job_template default-global-system-config:image_upgrade_template 10/21/2024 02:01:48.543 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:image_upgrade_template 10/21/2024 02:01:48.549 7fcaff0d2d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:image_upgrade_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "image_upgrade_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/image_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Image upgrade input\", \"type\": \"object\", \"properties\": {\"image_uuid\": {\"type\": \"string\"}}, \"required\": [\"image_uuid\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:48.550 7fcaff0d2d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:image_upgrade_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "image_upgrade_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/image_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Image upgrade input\", \"type\": \"object\", \"properties\": {\"image_uuid\": {\"type\": \"string\"}}, \"required\": [\"image_uuid\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:48.683 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'obj_dict': {'display_name': 'Image Upgrade', 'fq_name': ['default-global-system-config', 'image_upgrade_template'], 'id_perms': {'created': '2024-10-21T02:01:48.620387', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:48.620387', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9397013295712664047, 'uuid_mslong': 4927624436635813177}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Image upgrade input", ' '"type": "object", "properties": ' '{"image_uuid": {"type": ' '"string"}}, "required": ' '["image_uuid"]}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/image_upgrade.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '44627051-4436-4539-8268-e5ce109379ef'}, 'oper': 'CREATE', 'request-id': 'req-f1c8166b-8677-435a-8390-b57bb2a544cf', 'type': 'job_template', 'uuid': '44627051-4436-4539-8268-e5ce109379ef'} 10/21/2024 02:01:48.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:48.822 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'container_cleanup_template'] not found in DB: Unknown id: job_template default-global-system-config:container_cleanup_template 10/21/2024 02:01:48.822 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:container_cleanup_template 10/21/2024 02:01:48.869 7fcaff0568d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:container_cleanup_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "container_cleanup_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/container_cleanup.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup input\", \"type\": \"object\", \"required\": [\"fabric_fq_name\", \"container_name\"], \"properties\": {\"container_name\": {\"type\": \"string\"}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Container Cleanup", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:48.870 7fcaff0568d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:container_cleanup_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "container_cleanup_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/container_cleanup.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup input\", \"type\": \"object\", \"required\": [\"fabric_fq_name\", \"container_name\"], \"properties\": {\"container_name\": {\"type\": \"string\"}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Container cleanup output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Container Cleanup", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:48.977 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'obj_dict': {'display_name': 'Container Cleanup', 'fq_name': ['default-global-system-config', 'container_cleanup_template'], 'id_perms': {'created': '2024-10-21T02:01:48.905401', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:48.905401', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9416402314339578677, 'uuid_mslong': 10429117762346108279}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Container cleanup ' 'input", "type": "object", ' '"required": ["fabric_fq_name", ' '"container_name"], "properties": ' '{"container_name": {"type": ' '"string"}, "fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Container cleanup ' 'output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/container_cleanup.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '90bbab59-595b-4577-82ad-c803c0607335'}, 'oper': 'CREATE', 'request-id': 'req-73872bb9-eab9-49a8-8210-aad2da175165', 'type': 'job_template', 'uuid': '90bbab59-595b-4577-82ad-c803c0607335'} 10/21/2024 02:01:49.068 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cli_sync_template'] not found in DB: Unknown id: job_template default-global-system-config:cli_sync_template 10/21/2024 02:01:49.069 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:cli_sync_template 10/21/2024 02:01:49.099 7fcafefe4780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:cli_sync_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "cli_sync_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/cli_sync.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"CLI sync input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"devices_cli\": {\"type\": \"array\", \"items\": {\"title\": \"Devices CLI Items\", \"type\": \"object\", \"description\": \"Dictionaries of device details\", \"additionalProperties\": false, \"required\": [\"device_uuid\", \"cli_objects\"], \"properties\": {\"device_uuid\": {\"type\": \"string\", \"title\": \"UUIDs of the device\"}, \"cli_objects\": {\"type\": \"array\", \"title\": \"cli objects for that device\", \"items\": {\"type\": \"object\", \"required\": [\"time\", \"status\"], \"properties\": {\"time\": {\"type\": \"string\", \"title\": \"Timestamp of the cli change\"}, \"status\": {\"type\": \"string\", \"title\": \"Accept or Reject the commit\"}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Sync cli config with Contrail", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.099 7fcafefe4780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:cli_sync_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "cli_sync_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/cli_sync.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"CLI sync input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"devices_cli\": {\"type\": \"array\", \"items\": {\"title\": \"Devices CLI Items\", \"type\": \"object\", \"description\": \"Dictionaries of device details\", \"additionalProperties\": false, \"required\": [\"device_uuid\", \"cli_objects\"], \"properties\": {\"device_uuid\": {\"type\": \"string\", \"title\": \"UUIDs of the device\"}, \"cli_objects\": {\"type\": \"array\", \"title\": \"cli objects for that device\", \"items\": {\"type\": \"object\", \"required\": [\"time\", \"status\"], \"properties\": {\"time\": {\"type\": \"string\", \"title\": \"Timestamp of the cli change\"}, \"status\": {\"type\": \"string\", \"title\": \"Accept or Reject the commit\"}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Sync cli config with Contrail", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.177 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:49.177 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:49.177 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:49.177 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:49.178 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:49.179 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:49.179 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:49.179 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:49.179 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:49.179 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:49.179 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:49.180 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:49.181 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:49.182 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:49.183 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:49.183 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:49.185 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:49.185 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:49.185 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:49.185 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:49.185 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:49.186 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:49.187 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:49.187 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:49.188 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:49.188 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:49.188 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:49.188 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:49.189 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:49.189 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:49.189 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:49.190 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:49.190 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:49.190 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 10/21/2024 02:01:49.190 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:01:49.191 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:49.191 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:49.191 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:49.191 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:49.214 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cli_sync_template'], 'obj_dict': {'display_name': 'Sync cli config with Contrail', 'fq_name': ['default-global-system-config', 'cli_sync_template'], 'id_perms': {'created': '2024-10-21T02:01:49.128280', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.128280', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13413270063459373632, 'uuid_mslong': 5678251676569585749}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "CLI sync input", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "devices_cli": ' '{"type": "array", "items": ' '{"title": "Devices CLI Items", ' '"type": "object", "description": ' '"Dictionaries of device details", ' '"additionalProperties": false, ' '"required": ["device_uuid", ' '"cli_objects"], "properties": ' '{"device_uuid": {"type": "string", ' '"title": "UUIDs of the device"}, ' '"cli_objects": {"type": "array", ' '"title": "cli objects for that ' 'device", "items": {"type": ' '"object", "required": ["time", ' '"status"], "properties": {"time": ' '{"type": "string", "title": ' '"Timestamp of the cli change"}, ' '"status": {"type": "string", ' '"title": "Accept or Reject the ' 'commit"}}}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/cli_sync.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4ecd33d0-af32-4855-ba25-820e60e09240'}, 'oper': 'CREATE', 'request-id': 'req-df43d07b-4e36-433e-8dea-180951ed75d8', 'type': 'job_template', 'uuid': '4ecd33d0-af32-4855-ba25-820e60e09240'} 10/21/2024 02:01:49.241 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'opencontrail'] not found in DB: Unknown id: service_appliance_set default-global-system-config:opencontrail 10/21/2024 02:01:49.242 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_appliance_set default-global-system-config:opencontrail 10/21/2024 02:01:49.243 7fcafefe2d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:opencontrail url = https://10.0.0.30:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "opencontrail"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "opencontrail"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.244 7fcafefe2d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:opencontrail url = https://10.0.0.30:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "opencontrail"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "opencontrail"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.280 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'opencontrail'], 'obj_dict': {'display_name': 'opencontrail', 'fq_name': ['default-global-system-config', 'opencontrail'], 'id_perms': {'created': '2024-10-21T02:01:49.270473', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.270473', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11284742600502395823, 'uuid_mslong': 6564932885660126615}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service_appliance_driver': 'svc_monitor.services.loadbalancer.drivers.ha_proxy.driver.OpencontrailLoadbalancerDriver', 'uuid': '5b1b53ad-500d-4d97-9c9b-759b24a9c3af'}, 'oper': 'CREATE', 'request-id': 'req-39eebb58-594e-41bc-beb9-096400d54310', 'type': 'service_appliance_set', 'uuid': '5b1b53ad-500d-4d97-9c9b-759b24a9c3af'} 10/21/2024 02:01:49.319 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'hitless_upgrade_strategy_template'] not found in DB: Unknown id: job_template default-global-system-config:hitless_upgrade_strategy_template 10/21/2024 02:01:49.320 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:hitless_upgrade_strategy_template 10/21/2024 02:01:49.328 7fcaff00b588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hitless_upgrade_strategy_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hitless_upgrade_strategy_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 90, "sequence_no": 1}]}, "job_template_input_schema": "{\"title\": \"Image upgrade strategy input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"upgrade_mode\": {\"enum\": [\"test_run\", \"dry_run\", \"upgrade\"], \"description\": \"Mode in which to run workflow\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}, \"image_devices\": {\"type\": \"array\", \"items\": {\"title\": \"Image Devices\", \"type\": \"object\", \"description\": \"List of images and corresponding devices to upgrade\", \"additionalProperties\": false, \"properties\": {\"image_uuid\": {\"type\": \"string\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded with this image\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}}, \"required\": [\"image_uuid\", \"device_list\"]}}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable local interface down check\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable peer interface down check\", \"default\": true}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Hitless Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.328 7fcaff00b588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hitless_upgrade_strategy_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hitless_upgrade_strategy_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 90, "sequence_no": 1}]}, "job_template_input_schema": "{\"title\": \"Image upgrade strategy input\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"upgrade_mode\": {\"enum\": [\"test_run\", \"dry_run\", \"upgrade\"], \"description\": \"Mode in which to run workflow\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}, \"image_devices\": {\"type\": \"array\", \"items\": {\"title\": \"Image Devices\", \"type\": \"object\", \"description\": \"List of images and corresponding devices to upgrade\", \"additionalProperties\": false, \"properties\": {\"image_uuid\": {\"type\": \"string\"}, \"device_list\": {\"type\": \"array\", \"description\": \"List of device UUIDs to be upgraded with this image\", \"items\": {\"title\": \"device uuid\", \"type\": \"string\", \"format\": \"uuid\"}}}, \"required\": [\"image_uuid\", \"device_list\"]}}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable local interface down check\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable peer interface down check\", \"default\": true}}}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Hitless Image Upgrade", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.426 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'obj_dict': {'display_name': 'Hitless Image Upgrade', 'fq_name': ['default-global-system-config', 'hitless_upgrade_strategy_template'], 'id_perms': {'created': '2024-10-21T02:01:49.364318', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.364318', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12430633467524402280, 'uuid_mslong': 11153748647943031423}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Image upgrade strategy ' 'input", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "upgrade_mode": ' '{"enum": ["test_run", "dry_run", ' '"upgrade"], "description": "Mode ' 'in which to run workflow"}, ' '"device_list": {"type": "array", ' '"description": "List of device ' 'UUIDs to be upgraded", "items": ' '{"title": "device uuid", "type": ' '"string", "format": "uuid"}}, ' '"image_devices": {"type": "array", ' '"items": {"title": "Image ' 'Devices", "type": "object", ' '"description": "List of images and ' 'corresponding devices to upgrade", ' '"additionalProperties": false, ' '"properties": {"image_uuid": ' '{"type": "string"}, "device_list": ' '{"type": "array", "description": ' '"List of device UUIDs to be ' 'upgraded with this image", ' '"items": {"title": "device uuid", ' '"type": "string", "format": ' '"uuid"}}}, "required": ' '["image_uuid", "device_list"]}}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}, "lacp": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": ' '"Enable/disable local interface ' 'down check", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": ' '"Enable/disable peer interface ' 'down check", "default": ' 'true}}}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hitless_upgrade_strategy.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 90, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hitless_upgrade.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9aca134c-daa3-4a7f-ac82-7b4744dfcc68'}, 'oper': 'CREATE', 'request-id': 'req-ef4aa44f-0259-40a5-a369-2a3b1ec46acd', 'type': 'job_template', 'uuid': '9aca134c-daa3-4a7f-ac82-7b4744dfcc68'} 10/21/2024 02:01:49.446 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:49.446 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:49.446 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:49.446 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:49.446 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:49.447 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:49.447 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:49.447 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:49.447 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:49.448 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:49.449 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:49.450 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:49.451 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:49.452 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:49.452 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:49.452 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:49.452 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:49.452 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:49.453 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:49.454 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:49.454 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:49.454 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:49.454 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:49.454 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:49.454 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:49.455 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:49.455 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:49.456 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:49.456 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:49.456 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:49.456 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:49.457 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:49.458 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 10/21/2024 02:01:49.458 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:01:49.458 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:49.460 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:49.463 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:49.463 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:49.517 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'native'] not found in DB: Unknown id: service_appliance_set default-global-system-config:native 10/21/2024 02:01:49.517 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_appliance_set default-global-system-config:native 10/21/2024 02:01:49.518 7fcafef9ceb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:native url = https://10.0.0.30:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "native"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "native"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.519 7fcafef9ceb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_appliance_set identifier_name = default-global-system-config:native url = https://10.0.0.30:8082/service-appliance-sets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-appliance-set": {"uuid": null, "fq_name": ["default-global-system-config", "native"], "parent_type": "global-system-config", "service_appliance_driver": "svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver", "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 5, "share": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "display_name": "native"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.530 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'maintenance_mode_activate_template'] not found in DB: Unknown id: job_template default-global-system-config:maintenance_mode_activate_template 10/21/2024 02:01:49.530 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:maintenance_mode_activate_template 10/21/2024 02:01:49.539 7fcafefadac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_activate_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Activate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to enter maintenance mode\"}, \"mode\": {\"enum\": [\"test_run\", \"activate\"], \"description\": \"Mode in which to run workflow\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"validate_critical_roles\": {\"type\": \"boolean\", \"description\": \"Enable/disable critical role validation\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Activate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.539 7fcafefadac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_activate_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Activate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to enter maintenance mode\"}, \"mode\": {\"enum\": [\"test_run\", \"activate\"], \"description\": \"Mode in which to run workflow\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"validate_critical_roles\": {\"type\": \"boolean\", \"description\": \"Enable/disable critical role validation\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Activate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.554 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'native'], 'obj_dict': {'display_name': 'native', 'fq_name': ['default-global-system-config', 'native'], 'id_perms': {'created': '2024-10-21T02:01:49.542179', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.542179', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11730381877588425467, 'uuid_mslong': 17699653966450740544}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 5, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'service_appliance_driver': 'svc_monitor.services.loadbalancer.drivers.native.driver.OpencontrailLoadbalancerDriver', 'uuid': 'f5a1cd81-75a1-4d40-a2ca-b02add567afb'}, 'oper': 'CREATE', 'request-id': 'req-16900ec5-10a6-42dc-bd0e-cfbd0be0073a', 'type': 'service_appliance_set', 'uuid': 'f5a1cd81-75a1-4d40-a2ca-b02add567afb'} 10/21/2024 02:01:49.637 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'obj_dict': {'display_name': 'Maintenance Mode Activation', 'fq_name': ['default-global-system-config', 'maintenance_mode_activate_template'], 'id_perms': {'created': '2024-10-21T02:01:49.564638', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.564638', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13440006320533418733, 'uuid_mslong': 17221205446021434579}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"title": "Activate maintenance ' 'mode", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_uuid", ' '"device_uuid"], "properties": ' '{"fabric_uuid": {"format": "uuid", ' '"type": "string", "title": "Fabric ' 'UUID", "description": "UUID of the ' 'device fabric"}, "device_uuid": ' '{"format": "uuid", "type": ' '"string", "title": "Device UUID", ' '"description": "UUID of the device ' 'to enter maintenance mode"}, ' '"mode": {"enum": ["test_run", ' '"activate"], "description": "Mode ' 'in which to run workflow"}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"validate_critical_roles": ' '{"type": "boolean", "description": ' '"Enable/disable critical role ' 'validation", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, "lacp": {"type": ' '"object", "additionalProperties": ' 'false, "default": {}, ' '"properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'target device", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'peer device", "default": true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Activate maintenance ' 'mode output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/maintenance_mode_activate.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eefe031c-7e21-4cd3-ba84-7e8a526632ed'}, 'oper': 'CREATE', 'request-id': 'req-ac4a6279-8ada-4233-bc43-36e1d1b9b668', 'type': 'job_template', 'uuid': 'eefe031c-7e21-4cd3-ba84-7e8a526632ed'} 10/21/2024 02:01:49.674 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_DNS_refs in resource network-ipam: 'virtual_DNS_refs' 10/21/2024 02:01:49.674 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_DNS_refs' 10/21/2024 02:01:49.674 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource network-ipam: 'tag_refs' 10/21/2024 02:01:49.674 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:49.674 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource network-ipam: 'virtual_network_back_refs' 10/21/2024 02:01:49.675 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_network_back_refs' 10/21/2024 02:01:49.675 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_router_back_refs in resource network-ipam: 'virtual_router_back_refs' 10/21/2024 02:01:49.675 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_router_back_refs' 10/21/2024 02:01:49.675 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource network-ipam: 'instance_ip_back_refs' 10/21/2024 02:01:49.675 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:01:49.737 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'maintenance_mode_deactivate_template'] not found in DB: Unknown id: job_template default-global-system-config:maintenance_mode_deactivate_template 10/21/2024 02:01:49.737 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:maintenance_mode_deactivate_template 10/21/2024 02:01:49.745 7fcafefc2eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_deactivate_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_deactivate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Deactivate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to exit maintenance mode\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Deactivate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Deactivation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.746 7fcafefc2eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:maintenance_mode_deactivate_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "maintenance_mode_deactivate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Deactivate maintenance mode\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_uuid\", \"device_uuid\"], \"properties\": {\"fabric_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Fabric UUID\", \"description\": \"UUID of the device fabric\"}, \"device_uuid\": {\"format\": \"uuid\", \"type\": \"string\", \"title\": \"Device UUID\", \"description\": \"UUID of the device to exit maintenance mode\"}, \"advanced_parameters\": {\"title\": \"Advanced parameters\", \"description\": \"Optional parameters used to override defaults\", \"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bulk_device_upgrade_count\": {\"type\": \"integer\", \"description\": \"Maximum number of devices to upgrade simultaneously\", \"default\": 4}, \"health_check_abort\": {\"type\": \"boolean\", \"description\": \"Enable/disable abort upon health check failures\", \"default\": true}, \"Juniper\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"bgp_flap_count\": {\"type\": \"integer\", \"description\": \"Number of flaps allowed for BGP neighbors\", \"default\": 4}, \"bgp_flap_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_flap_count check\", \"default\": true}, \"bgp_down_peer_count\": {\"type\": \"integer\", \"description\": \"Number of down peers allowed\", \"default\": 0}, \"bgp_down_peer_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp_down_peer_count check\", \"default\": true}, \"bgp_peer_state_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable bgp peer state check\", \"default\": true}}}, \"alarm\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"system_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable system alarm check\", \"default\": true}, \"chassis_alarm_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable chassis alarm check\", \"default\": true}}}, \"interface\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"interface_error_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface error check\", \"default\": true}, \"interface_drop_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface drop check\", \"default\": true}, \"interface_carrier_transition_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable interface carrier transition check\", \"default\": true}}}, \"routing_engine\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"routing_engine_cpu_idle\": {\"type\": \"integer\", \"description\": \"Routing engine CPU idle time\", \"default\": 60}, \"routing_engine_cpu_idle_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable routing engine CLU idle time check\", \"default\": true}}}, \"fpc\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"fpc_cpu_5min_avg\": {\"type\": \"integer\", \"description\": \"FPC CPU 5 minute average utilization\", \"default\": 50}, \"fpc_cpu_5min_avg_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC CPU 5 minute average utilizationcheck\", \"default\": true}, \"fpc_memory_heap_util\": {\"type\": \"integer\", \"description\": \"FPC memory heap utilization\", \"default\": 45}, \"fpc_memory_heap_util_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable FPC memory heap utilization check\", \"default\": true}}}, \"lacp\": {\"type\": \"object\", \"additionalProperties\": false, \"default\": {}, \"properties\": {\"lacp_down_local_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on target device\", \"default\": true}, \"lacp_down_peer_check\": {\"type\": \"boolean\", \"description\": \"Enable lacp interface status check on peer device\", \"default\": true}}}, \"active_route_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable active route count check\", \"default\": true}, \"l2_total_mac_count_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable l2 total mac count check\", \"default\": true}, \"storm_control_flag_check\": {\"type\": \"boolean\", \"description\": \"Enable/disable storm control flag check\", \"default\": true}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Deactivate maintenance mode output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Maintenance Mode Deactivation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:49.854 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'obj_dict': {'display_name': 'Maintenance Mode Deactivation', 'fq_name': ['default-global-system-config', 'maintenance_mode_deactivate_template'], 'id_perms': {'created': '2024-10-21T02:01:49.789729', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.789729', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12270022040590754223, 'uuid_mslong': 4718961448933870971}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"title": "Deactivate maintenance ' 'mode", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_uuid", ' '"device_uuid"], "properties": ' '{"fabric_uuid": {"format": "uuid", ' '"type": "string", "title": "Fabric ' 'UUID", "description": "UUID of the ' 'device fabric"}, "device_uuid": ' '{"format": "uuid", "type": ' '"string", "title": "Device UUID", ' '"description": "UUID of the device ' 'to exit maintenance mode"}, ' '"advanced_parameters": {"title": ' '"Advanced parameters", ' '"description": "Optional ' 'parameters used to override ' 'defaults", "type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bulk_device_upgrade_count": ' '{"type": "integer", "description": ' '"Maximum number of devices to ' 'upgrade simultaneously", ' '"default": 4}, ' '"health_check_abort": {"type": ' '"boolean", "description": ' '"Enable/disable abort upon health ' 'check failures", "default": true}, ' '"Juniper": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"bgp_flap_count": {"type": ' '"integer", "description": "Number ' 'of flaps allowed for BGP ' 'neighbors", "default": 4}, ' '"bgp_flap_count_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp_flap_count ' 'check", "default": true}, ' '"bgp_down_peer_count": {"type": ' '"integer", "description": "Number ' 'of down peers allowed", "default": ' '0}, "bgp_down_peer_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable ' 'bgp_down_peer_count check", ' '"default": true}, ' '"bgp_peer_state_check": {"type": ' '"boolean", "description": ' '"Enable/disable bgp peer state ' 'check", "default": true}}}, ' '"alarm": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"system_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable system alarm ' 'check", "default": true}, ' '"chassis_alarm_check": {"type": ' '"boolean", "description": ' '"Enable/disable chassis alarm ' 'check", "default": true}}}, ' '"interface": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"interface_error_check": {"type": ' '"boolean", "description": ' '"Enable/disable interface error ' 'check", "default": true}, ' '"interface_drop_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface drop ' 'check", "default": true}, ' '"interface_carrier_transition_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable interface carrier ' 'transition check", "default": ' 'true}}}, "routing_engine": ' '{"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"routing_engine_cpu_idle": ' '{"type": "integer", "description": ' '"Routing engine CPU idle time", ' '"default": 60}, ' '"routing_engine_cpu_idle_check": ' '{"type": "boolean", "description": ' '"Enable/disable routing engine CLU ' 'idle time check", "default": ' 'true}}}, "fpc": {"type": "object", ' '"additionalProperties": false, ' '"default": {}, "properties": ' '{"fpc_cpu_5min_avg": {"type": ' '"integer", "description": "FPC CPU ' '5 minute average utilization", ' '"default": 50}, ' '"fpc_cpu_5min_avg_check": {"type": ' '"boolean", "description": ' '"Enable/disable FPC CPU 5 minute ' 'average utilizationcheck", ' '"default": true}, ' '"fpc_memory_heap_util": {"type": ' '"integer", "description": "FPC ' 'memory heap utilization", ' '"default": 45}, ' '"fpc_memory_heap_util_check": ' '{"type": "boolean", "description": ' '"Enable/disable FPC memory heap ' 'utilization check", "default": ' 'true}}}, "lacp": {"type": ' '"object", "additionalProperties": ' 'false, "default": {}, ' '"properties": ' '{"lacp_down_local_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'target device", "default": true}, ' '"lacp_down_peer_check": {"type": ' '"boolean", "description": "Enable ' 'lacp interface status check on ' 'peer device", "default": true}}}, ' '"active_route_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable active route count ' 'check", "default": true}, ' '"l2_total_mac_count_check": ' '{"type": "boolean", "description": ' '"Enable/disable l2 total mac count ' 'check", "default": true}, ' '"storm_control_flag_check": ' '{"type": "boolean", "description": ' '"Enable/disable storm control flag ' 'check", "default": true}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Deactivate maintenance ' 'mode output", "type": "object", ' '"properties": {"status": {"type": ' '"string", "enum": ["Success", ' '"Failure", "Timeout"], ' '"description": "Result status of ' 'the job"}, "message": {"type": ' '"string", "description": "Should ' 'capture a summarized error ' 'message in case of Failures."}, ' '"results": {"type": "object", ' '"description": "JSON object ' 'holding the job specific output ' 'details"}}, "required": ' '["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/maintenance_mode_deactivate.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '417d1e6f-8877-4d7b-aa47-e0095ba021af'}, 'oper': 'CREATE', 'request-id': 'req-793b0e5b-553d-4a93-8355-56b551acf93c', 'type': 'job_template', 'uuid': '417d1e6f-8877-4d7b-aa47-e0095ba021af'} 10/21/2024 02:01:49.955 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_device_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_device_template 10/21/2024 02:01:49.955 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:discover_device_template 10/21/2024 02:01:49.962 7fcaff6acc18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_device_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_device_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 1, \"maxProperties\": 1, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Device", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.962 7fcaff6acc18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_device_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_device_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 1, \"maxProperties\": 1, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Device", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.982 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'analyzer-template'] not found in DB: Unknown id: service_template default-domain:analyzer-template 10/21/2024 02:01:49.983 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_template default-domain:analyzer-template 10/21/2024 02:01:49.984 7fcafefd06d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:analyzer-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "analyzer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": null, "service_type": "analyzer", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "analyzer-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:49.985 7fcafefd06d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:analyzer-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "analyzer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": null, "service_type": "analyzer", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "analyzer-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.059 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_device_template'], 'obj_dict': {'display_name': 'Discover Device', 'fq_name': ['default-global-system-config', 'discover_device_template'], 'id_perms': {'created': '2024-10-21T02:01:49.991299', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:49.991299', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11848470396200769326, 'uuid_mslong': 7364941494252751188}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"minProperties": 1, ' '"maxProperties": 1, ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"fabric_fq_name": {"$id": ' '"/properties/input/properties/fabric_fq_name", ' '"type": "array", "items": {"$id": ' '"/properties/input/properties/fabric_fq_name/items", ' '"type": "string", "title": "The ' 'Fabric_fq_name Schema", ' '"description": "FQNAME of the ' 'fabric object created", "default": ' '"", "examples": ' '["default-global-system-config", ' '"fabric01"]}}, "manage_underlay": ' '{"type": "boolean", "title": ' '"Manage underlay networking", ' '"description": "Set to true if ' 'need to configure device underlay ' 'networking"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"output": {"$id": ' '"/properties/output", "type": ' '"object", "properties": ' '{"status": {"$id": ' '"/properties/output/properties/status", ' '"type": "string", "title": "The ' 'Status Schema", "description": ' '"Status of the plabybook run", ' '"default": "", "examples": ' '["SUCCESS"]}, "message": {"$id": ' '"/properties/output/properties/message", ' '"type": "string", "title": "The ' 'Message Schema", "description": ' '"success/failure message about ' 'the playbook run", "default": "", ' '"examples": ["Successfully ran ' 'playbook"]}, "results": {"$id": ' '"/properties/output/properties/results", ' '"type": "object", "properties": ' '{"device_uuid": {"$id": ' '"/properties/output/properties/results/properties/device_uuid", ' '"type": "array", "items": {"$id": ' '"/properties/output/properties/results/properties/device_uuid/items", ' '"format": "uuid", "type": ' '"string", "title": "The Results ' 'Schema", "description": "objects ' 'returned from the playbook to ' 'the job_manager", "default": "", ' '"examples": ["1234"]}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '66358744-9478-4954-a46e-390ca947572e'}, 'oper': 'CREATE', 'request-id': 'req-b27f16b7-eabc-4022-bf0e-fcaa80dda5d3', 'type': 'job_template', 'uuid': '66358744-9478-4954-a46e-390ca947572e'} 10/21/2024 02:01:50.098 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'analyzer-template'], 'obj_dict': {'display_name': 'analyzer-template', 'fq_name': ['default-domain', 'analyzer-template'], 'id_perms': {'created': '2024-10-21T02:01:50.054065', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.054065', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9360357589189016435, 'uuid_mslong': 11250222876402208316}}, 'parent_type': 'domain', 'parent_uuid': '7708a312-0796-4efe-a074-f3667a87baf2', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': [{'tenant': 'domain:7708a312-0796-4efe-a074-f3667a87baf2', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': 'm1.medium', 'image_name': 'analyzer', 'instance_data': None, 'interface_type': [{'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': None, 'service_scaling': False, 'service_type': 'analyzer', 'service_virtualization_type': 'virtual-machine', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '9c20d219-8fed-4e3c-81e6-aba2523e3b73'}, 'oper': 'CREATE', 'request-id': 'req-f7880534-f332-4374-b099-39d55ac6476f', 'type': 'service_template', 'uuid': '9c20d219-8fed-4e3c-81e6-aba2523e3b73'} 10/21/2024 02:01:50.149 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'nat-template'] not found in DB: Unknown id: service_template default-domain:nat-template 10/21/2024 02:01:50.150 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_template default-domain:nat-template 10/21/2024 02:01:50.151 7fcaff00bac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:nat-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "nat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "firewall", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "nat-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.151 7fcaff00bac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:nat-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "nat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "firewall", "image_name": "analyzer", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": "m1.medium", "ordered_interfaces": true, "service_virtualization_type": "virtual-machine", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "nat-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.161 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_os_computes_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_os_computes_template 10/21/2024 02:01:50.161 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:discover_os_computes_template 10/21/2024 02:01:50.181 7fcafef66048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_os_computes_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_os_computes_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 2, \"maxProperties\": 5, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"contrail_command_host\": {\"$id\": \"/properties/input/properties/contrail_command_host\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"10.10.10.10:9091\"]}, \"cc_username\": {\"$id\": \"/properties/input/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/input/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover OS Computes", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.182 7fcafef66048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_os_computes_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_os_computes_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"minProperties\": 2, \"maxProperties\": 5, \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"contrail_command_host\": {\"$id\": \"/properties/input/properties/contrail_command_host\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"10.10.10.10:9091\"]}, \"cc_username\": {\"$id\": \"/properties/input/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/input/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"fabric_fq_name\": {\"$id\": \"/properties/input/properties/fabric_fq_name\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/input/properties/fabric_fq_name/items\", \"type\": \"string\", \"title\": \"The Fabric_fq_name Schema\", \"description\": \"FQNAME of the fabric object created\", \"default\": \"\", \"examples\": [\"default-global-system-config\", \"fabric01\"]}}, \"manage_underlay\": {\"type\": \"boolean\", \"title\": \"Manage underlay networking\", \"description\": \"Set to true if need to configure device underlay networking\"}}}", "job_template_output_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"output\": {\"$id\": \"/properties/output\", \"type\": \"object\", \"properties\": {\"status\": {\"$id\": \"/properties/output/properties/status\", \"type\": \"string\", \"title\": \"The Status Schema\", \"description\": \"Status of the plabybook run\", \"default\": \"\", \"examples\": [\"SUCCESS\"]}, \"message\": {\"$id\": \"/properties/output/properties/message\", \"type\": \"string\", \"title\": \"The Message Schema\", \"description\": \"success/failure message about the playbook run\", \"default\": \"\", \"examples\": [\"Successfully ran playbook\"]}, \"results\": {\"$id\": \"/properties/output/properties/results\", \"type\": \"object\", \"properties\": {\"device_uuid\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/output/properties/results/properties/device_uuid/items\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Results Schema\", \"description\": \"objects returned from the playbook to the job_manager\", \"default\": \"\", \"examples\": [\"1234\"]}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover OS Computes", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.209 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'nat-template'], 'obj_dict': {'display_name': 'nat-template', 'fq_name': ['default-domain', 'nat-template'], 'id_perms': {'created': '2024-10-21T02:01:50.190815', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.190815', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13578916007617972965, 'uuid_mslong': 1415649441833044932}}, 'parent_type': 'domain', 'parent_uuid': '7708a312-0796-4efe-a074-f3667a87baf2', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': [{'tenant': 'domain:7708a312-0796-4efe-a074-f3667a87baf2', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': 'm1.medium', 'image_name': 'analyzer', 'instance_data': None, 'interface_type': [{'service_interface_type': 'management', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'right', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': False, 'service_type': 'firewall', 'service_virtualization_type': 'virtual-machine', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '13a565aa-baf0-4bc4-bc72-002a2cef4ae5'}, 'oper': 'CREATE', 'request-id': 'req-6bfd60b8-584f-46c8-be79-ddf46b31e1a5', 'type': 'service_template', 'uuid': '13a565aa-baf0-4bc4-bc72-002a2cef4ae5'} 10/21/2024 02:01:50.276 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'obj_dict': {'display_name': 'Discover OS Computes', 'fq_name': ['default-global-system-config', 'discover_os_computes_template'], 'id_perms': {'created': '2024-10-21T02:01:50.212384', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.212384', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12607819374694666034, 'uuid_mslong': 16659198326830482499}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"minProperties": 2, ' '"maxProperties": 5, ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"contrail_command_host": {"$id": ' '"/properties/input/properties/contrail_command_host", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["10.10.10.10:9091"]}, ' '"cc_username": {"$id": ' '"/properties/input/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/input/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, "fabric_fq_name": ' '{"$id": ' '"/properties/input/properties/fabric_fq_name", ' '"type": "array", "items": {"$id": ' '"/properties/input/properties/fabric_fq_name/items", ' '"type": "string", "title": "The ' 'Fabric_fq_name Schema", ' '"description": "FQNAME of the ' 'fabric object created", "default": ' '"", "examples": ' '["default-global-system-config", ' '"fabric01"]}}, "manage_underlay": ' '{"type": "boolean", "title": ' '"Manage underlay networking", ' '"description": "Set to true if ' 'need to configure device underlay ' 'networking"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"output": {"$id": ' '"/properties/output", "type": ' '"object", "properties": ' '{"status": {"$id": ' '"/properties/output/properties/status", ' '"type": "string", "title": "The ' 'Status Schema", "description": ' '"Status of the plabybook run", ' '"default": "", "examples": ' '["SUCCESS"]}, "message": {"$id": ' '"/properties/output/properties/message", ' '"type": "string", "title": "The ' 'Message Schema", "description": ' '"success/failure message about ' 'the playbook run", "default": "", ' '"examples": ["Successfully ran ' 'playbook"]}, "results": {"$id": ' '"/properties/output/properties/results", ' '"type": "object", "properties": ' '{"device_uuid": {"$id": ' '"/properties/output/properties/results/properties/device_uuid", ' '"type": "array", "items": {"$id": ' '"/properties/output/properties/results/properties/device_uuid/items", ' '"format": "uuid", "type": ' '"string", "title": "The Results ' 'Schema", "description": "objects ' 'returned from the playbook to ' 'the job_manager", "default": "", ' '"examples": ["1234"]}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_os_computes_template.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e7315c9d-3183-4443-aef7-f8ec14f68f32'}, 'oper': 'CREATE', 'request-id': 'req-57cc909c-709d-41ad-ada6-289a41d1a2d6', 'type': 'job_template', 'uuid': 'e7315c9d-3183-4443-aef7-f8ec14f68f32'} 10/21/2024 02:01:50.306 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'netns-snat-template'] not found in DB: Unknown id: service_template default-domain:netns-snat-template 10/21/2024 02:01:50.308 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_template default-domain:netns-snat-template 10/21/2024 02:01:50.310 7fcafef6e240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:netns-snat-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "netns-snat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "source-nat", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netns-snat-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.310 7fcafef6e240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:netns-snat-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "netns-snat-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "source-nat", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netns-snat-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.348 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'netns-snat-template'], 'obj_dict': {'display_name': 'netns-snat-template', 'fq_name': ['default-domain', 'netns-snat-template'], 'id_perms': {'created': '2024-10-21T02:01:50.338160', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.338160', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12265633769868948655, 'uuid_mslong': 15263227203469001593}}, 'parent_type': 'domain', 'parent_uuid': '7708a312-0796-4efe-a074-f3667a87baf2', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': [{'tenant': 'domain:7708a312-0796-4efe-a074-f3667a87baf2', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': None, 'instance_data': None, 'interface_type': [{'service_interface_type': 'right', 'shared_ip': True, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': True, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': True, 'service_type': 'source-nat', 'service_virtualization_type': 'network-namespace', 'version': 1, 'vrouter_instance_type': None}, 'uuid': 'd3d1e046-04d9-4379-aa38-48ed7612f4af'}, 'oper': 'CREATE', 'request-id': 'req-85e15185-ea9c-4ddd-89d7-25bf6d4025bb', 'type': 'service_template', 'uuid': 'd3d1e046-04d9-4379-aa38-48ed7612f4af'} 10/21/2024 02:01:50.380 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_role_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_role_template 10/21/2024 02:01:50.381 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:discover_role_template 10/21/2024 02:01:50.389 7fcaff053ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_role_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_role_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Role", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.389 7fcaff053ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_role_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_role_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Discover Role", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.423 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'haproxy-loadbalancer-template'] not found in DB: Unknown id: service_template default-domain:haproxy-loadbalancer-template 10/21/2024 02:01:50.423 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_template default-domain:haproxy-loadbalancer-template 10/21/2024 02:01:50.425 7fcafef85eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:haproxy-loadbalancer-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "haproxy-loadbalancer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "loadbalancer", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "haproxy-loadbalancer-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.425 7fcafef85eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:haproxy-loadbalancer-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "haproxy-loadbalancer-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "in-network-nat", "service_type": "loadbalancer", "image_name": null, "service_scaling": true, "interface_type": [{"service_interface_type": "right", "shared_ip": true, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": true, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "network-namespace", "availability_zone_enable": false, "vrouter_instance_type": null, "instance_data": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "haproxy-loadbalancer-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.486 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_role_template'], 'obj_dict': {'display_name': 'Discover Role', 'fq_name': ['default-global-system-config', 'discover_role_template'], 'id_perms': {'created': '2024-10-21T02:01:50.419443', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.419443', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10915635247375128587, 'uuid_mslong': 9286041770467609037}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '80dea5ca-6a29-49cd-977c-206c8987180b'}, 'oper': 'CREATE', 'request-id': 'req-8b981215-b0d0-48de-8896-de7163cc28ae', 'type': 'job_template', 'uuid': '80dea5ca-6a29-49cd-977c-206c8987180b'} 10/21/2024 02:01:50.507 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'haproxy-loadbalancer-template'], 'obj_dict': {'display_name': 'haproxy-loadbalancer-template', 'fq_name': ['default-domain', 'haproxy-loadbalancer-template'], 'id_perms': {'created': '2024-10-21T02:01:50.482445', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.482445', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13700524183333193560, 'uuid_mslong': 471069138010393103}}, 'parent_type': 'domain', 'parent_uuid': '7708a312-0796-4efe-a074-f3667a87baf2', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': [{'tenant': 'domain:7708a312-0796-4efe-a074-f3667a87baf2', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': None, 'instance_data': None, 'interface_type': [{'service_interface_type': 'right', 'shared_ip': True, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': True, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'in-network-nat', 'service_scaling': True, 'service_type': 'loadbalancer', 'service_virtualization_type': 'network-namespace', 'version': 1, 'vrouter_instance_type': None}, 'uuid': '068992e2-9bc2-4a0f-be22-0a2800394758'}, 'oper': 'CREATE', 'request-id': 'req-32b6cc06-ac12-4058-920a-f7f5bcf192ea', 'type': 'service_template', 'uuid': '068992e2-9bc2-4a0f-be22-0a2800394758'} 10/21/2024 02:01:50.574 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'docker-template'] not found in DB: Unknown id: service_template default-domain:docker-template 10/21/2024 02:01:50.575 7fcb08885828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: service_template default-domain:docker-template 10/21/2024 02:01:50.576 7fcafef8ea20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:docker-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "docker-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "transparent", "service_type": "firewall", "image_name": "ubuntu", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "vrouter-instance", "availability_zone_enable": false, "vrouter_instance_type": "docker", "instance_data": "{\"command\":\"/bin/bash\"}"}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "docker-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.576 7fcafef8ea20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = service_template identifier_name = default-domain:docker-template url = https://10.0.0.30:8082/service-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-svc-monitor remote_ip = 10.0.0.30 body = {"service-template": {"uuid": null, "fq_name": ["default-domain", "docker-template"], "parent_type": "domain", "service_template_properties": {"version": 1, "service_mode": "transparent", "service_type": "firewall", "image_name": "ubuntu", "service_scaling": false, "interface_type": [{"service_interface_type": "management", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "left", "shared_ip": false, "static_route_enable": false}, {"service_interface_type": "right", "shared_ip": false, "static_route_enable": false}], "flavor": null, "ordered_interfaces": true, "service_virtualization_type": "vrouter-instance", "availability_zone_enable": false, "vrouter_instance_type": "docker", "instance_data": "{\"command\":\"/bin/bash\"}"}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "docker-template"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.588 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'device_import_template'] not found in DB: Unknown id: job_template default-global-system-config:device_import_template 10/21/2024 02:01:50.589 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:device_import_template 10/21/2024 02:01:50.602 7fcafef66240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_import_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_import_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 1}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"additionalProperties\": false, \"properties\": {\"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported.\"}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.602 7fcafef66240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_import_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_import_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 1}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"additionalProperties\": false, \"properties\": {\"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported.\"}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.622 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'docker-template'], 'obj_dict': {'display_name': 'docker-template', 'fq_name': ['default-domain', 'docker-template'], 'id_perms': {'created': '2024-10-21T02:01:50.606089', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.606089', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10781525451395647728, 'uuid_mslong': 3807294289066344732}}, 'parent_type': 'domain', 'parent_uuid': '7708a312-0796-4efe-a074-f3667a87baf2', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': [{'tenant': 'domain:7708a312-0796-4efe-a074-f3667a87baf2', 'tenant_access': 5}]}, 'service_template_properties': {'availability_zone_enable': False, 'flavor': None, 'image_name': 'ubuntu', 'instance_data': '{"command":"/bin/bash"}', 'interface_type': [{'service_interface_type': 'management', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'left', 'shared_ip': False, 'static_route_enable': False}, {'service_interface_type': 'right', 'shared_ip': False, 'static_route_enable': False}], 'ordered_interfaces': True, 'service_mode': 'transparent', 'service_scaling': False, 'service_type': 'firewall', 'service_virtualization_type': 'vrouter-instance', 'version': 1, 'vrouter_instance_type': 'docker'}, 'uuid': '34d639fb-e72c-411c-959f-ac466b4548f0'}, 'oper': 'CREATE', 'request-id': 'req-7fd88c4f-236c-4af3-b966-69174b4bef14', 'type': 'service_template', 'uuid': '34d639fb-e72c-411c-959f-ac466b4548f0'} 10/21/2024 02:01:50.700 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'device_import_template'], 'obj_dict': {'display_name': 'Device Import', 'fq_name': ['default-global-system-config', 'device_import_template'], 'id_perms': {'created': '2024-10-21T02:01:50.627886', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.627886', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10421028667245253438, 'uuid_mslong': 1639217322093986462}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"additionalProperties": false, ' '"properties": ' '{"import_configured": {"type": ' '"boolean", "default": false, ' '"description": "Not importing ' 'configured interfaces by default. ' 'Set this option to true if ' 'configured interfaces need to be ' 'imported."}, "interface_filters": ' '{"$id": ' '"/properties/interface_filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "maxProperties": ' '2, "additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '16bfab78-3114-429e-909e-ee5c2150d33e'}, 'oper': 'CREATE', 'request-id': 'req-8c5713e7-49b8-4267-a942-11382ead30bd', 'type': 'job_template', 'uuid': '16bfab78-3114-429e-909e-ee5c2150d33e'} 10/21/2024 02:01:50.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:50.783 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'fabric_config_template'] not found in DB: Unknown id: job_template default-global-system-config:fabric_config_template 10/21/2024 02:01:50.784 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:fabric_config_template 10/21/2024 02:01:50.809 7fcafefb0240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_config_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_config_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/fabric_config.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"device_management_ip\": {\"type\": \"string\", \"description\": \"Management IP of the Device\"}, \"device_abstract_config\": {\"type\": \"object\", \"description\": \"JSON string of the device abstract config derived from VNC data model\"}, \"additional_feature_params\": {\"type\": \"object\", \"additionalProperties\": false, \"description\": \"Additional feature specific parameters that are not defined in the VNC data model. These could be vendor specific parameters.\", \"properties\": {\"basic\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp_boot_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP Boot server\", \"examples\": [\"6.6.6.6\"]}}, \"ntp_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP server\", \"examples\": [\"8.8.8.8\"]}}, \"time_zone\": {\"type\": \"string\", \"title\": \"Time Zone\", \"examples\": [\"America/Los_Angeles\"]}}}, \"name_servers\": {\"type\": \"array\", \"additionalProperties\": false, \"items\": {\"type\": \"string\", \"Title\": \"Domain Name Server\", \"examples\": [\"10.1.1.2\", \"11.1.1.2\"]}}, \"domain_name\": {\"type\": \"string\", \"title\": \"Domain Name\", \"examples\": [\"company.net\"]}, \"snmp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"communities\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\"}, \"readonly\": {\"type\": \"boolean\", \"default\": true}}, \"required\": [\"name\"]}}}}, \"static_routes\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"subnets\", \"nexthop\"], \"properties\": {\"subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"Subnet\", \"examples\": [\"10.1.1.0/24\", \"10.1.2.0/24\"]}}, \"nexthop\": {\"type\": \"string\", \"title\": \"Next hop IP\", \"examples\": [\"10.1.1.254\"]}}}}}}, \"underlay_ip_clos\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"bgp_hold_time\": {\"type\": \"integer\", \"default\": 90}}}}}, \"is_delete\": {\"type\": \"boolean\", \"description\": \"Set to true for config delete operation\", \"default\": false}, \"manage_underlay\": {\"type\": \"boolean\", \"description\": \"Set to true to manage underlay config\", \"default\": true}, \"enterprise_style\": {\"type\": \"boolean\", \"description\": \"Set to true to if enterprise-style config\", \"default\": true}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Config Push", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.809 7fcafefb0240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_config_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_config_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/fabric_config.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"device_management_ip\": {\"type\": \"string\", \"description\": \"Management IP of the Device\"}, \"device_abstract_config\": {\"type\": \"object\", \"description\": \"JSON string of the device abstract config derived from VNC data model\"}, \"additional_feature_params\": {\"type\": \"object\", \"additionalProperties\": false, \"description\": \"Additional feature specific parameters that are not defined in the VNC data model. These could be vendor specific parameters.\", \"properties\": {\"basic\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ntp_boot_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP Boot server\", \"examples\": [\"6.6.6.6\"]}}, \"ntp_servers\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"NTP server\", \"examples\": [\"8.8.8.8\"]}}, \"time_zone\": {\"type\": \"string\", \"title\": \"Time Zone\", \"examples\": [\"America/Los_Angeles\"]}}}, \"name_servers\": {\"type\": \"array\", \"additionalProperties\": false, \"items\": {\"type\": \"string\", \"Title\": \"Domain Name Server\", \"examples\": [\"10.1.1.2\", \"11.1.1.2\"]}}, \"domain_name\": {\"type\": \"string\", \"title\": \"Domain Name\", \"examples\": [\"company.net\"]}, \"snmp\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"communities\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\"}, \"readonly\": {\"type\": \"boolean\", \"default\": true}}, \"required\": [\"name\"]}}}}, \"static_routes\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"subnets\", \"nexthop\"], \"properties\": {\"subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"title\": \"Subnet\", \"examples\": [\"10.1.1.0/24\", \"10.1.2.0/24\"]}}, \"nexthop\": {\"type\": \"string\", \"title\": \"Next hop IP\", \"examples\": [\"10.1.1.254\"]}}}}}}, \"underlay_ip_clos\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"bgp_hold_time\": {\"type\": \"integer\", \"default\": 90}}}}}, \"is_delete\": {\"type\": \"boolean\", \"description\": \"Set to true for config delete operation\", \"default\": false}, \"manage_underlay\": {\"type\": \"boolean\", \"description\": \"Set to true to manage underlay config\", \"default\": true}, \"enterprise_style\": {\"type\": \"boolean\", \"description\": \"Set to true to if enterprise-style config\", \"default\": true}, \"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Config Push", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:50.893 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_config_template'], 'obj_dict': {'display_name': 'Device Config Push', 'fq_name': ['default-global-system-config', 'fabric_config_template'], 'id_perms': {'created': '2024-10-21T02:01:50.834974', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:50.834974', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10634019501380700531, 'uuid_mslong': 12817260124296986960}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"device_management_ip": {"type": ' '"string", "description": ' '"Management IP of the Device"}, ' '"device_abstract_config": {"type": ' '"object", "description": "JSON ' 'string of the device abstract ' 'config derived from VNC data ' 'model"}, ' '"additional_feature_params": ' '{"type": "object", ' '"additionalProperties": false, ' '"description": "Additional feature ' 'specific parameters that are not ' 'defined in the VNC data model. ' 'These could be vendor specific ' 'parameters.", "properties": ' '{"basic": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"ntp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"ntp_boot_servers": {"type": ' '"array", "items": {"type": ' '"string", "title": "NTP Boot ' 'server", "examples": ' '["6.6.6.6"]}}, "ntp_servers": ' '{"type": "array", "items": ' '{"type": "string", "title": "NTP ' 'server", "examples": ' '["8.8.8.8"]}}, "time_zone": ' '{"type": "string", "title": "Time ' 'Zone", "examples": ' '["America/Los_Angeles"]}}}, ' '"name_servers": {"type": "array", ' '"additionalProperties": false, ' '"items": {"type": "string", ' '"Title": "Domain Name Server", ' '"examples": ["10.1.1.2", ' '"11.1.1.2"]}}, "domain_name": ' '{"type": "string", "title": ' '"Domain Name", "examples": ' '["company.net"]}, "snmp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"communities": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string"}, "readonly": {"type": ' '"boolean", "default": true}}, ' '"required": ["name"]}}}}, ' '"static_routes": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"required": ["subnets", ' '"nexthop"], "properties": ' '{"subnets": {"type": "array", ' '"items": {"type": "string", ' '"title": "Subnet", "examples": ' '["10.1.1.0/24", "10.1.2.0/24"]}}, ' '"nexthop": {"type": "string", ' '"title": "Next hop IP", ' '"examples": ["10.1.1.254"]}}}}}}, ' '"underlay_ip_clos": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"bgp_hold_time": {"type": ' '"integer", "default": 90}}}}}, ' '"is_delete": {"type": "boolean", ' '"description": "Set to true for ' 'config delete operation", ' '"default": false}, ' '"manage_underlay": {"type": ' '"boolean", "description": "Set to ' 'true to manage underlay config", ' '"default": true}, ' '"enterprise_style": {"type": ' '"boolean", "description": "Set to ' 'true to if enterprise-style ' 'config", "default": true}, ' '"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_uuid": ' '{"type": "string", "format": ' '"uuid"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b1e00e2c-9e80-4150-9393-a065225f8973'}, 'oper': 'CREATE', 'request-id': 'req-50fae8ae-df75-4973-a92e-356b4a1a3f79', 'type': 'job_template', 'uuid': 'b1e00e2c-9e80-4150-9393-a065225f8973'} 10/21/2024 02:01:51.014 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ztp_template'] not found in DB: Unknown id: job_template default-global-system-config:ztp_template 10/21/2024 02:01:51.015 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:ztp_template 10/21/2024 02:01:51.027 7fcaff0d36d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:ztp_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "ztp_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"device_count\": {\"$id\": \"/properties/input/properties/device_count\", \"type\": \"integer\", \"title\": \"The Device Count Schema\", \"description\": \"Number of devices to discover\", \"default\": 0, \"examples\": [1, 2, 3, 4, 5]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "ZTP", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.058 7fcaff0d36d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:ztp_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "ztp_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"type\": \"object\", \"definitions\": {}, \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"properties\": {\"fabric_uuid\": {\"$id\": \"/properties/input/properties/fabric_uuid\", \"format\": \"uuid\", \"type\": \"string\", \"title\": \"The Fabric_uuid Schema\", \"description\": \"UUID of the fabric object created\", \"default\": \"\", \"examples\": [\"123456789\"]}, \"device_count\": {\"$id\": \"/properties/input/properties/device_count\", \"type\": \"integer\", \"title\": \"The Device Count Schema\", \"description\": \"Number of devices to discover\", \"default\": 0, \"examples\": [1, 2, 3, 4, 5]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "ZTP", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.270 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ztp_template'], 'obj_dict': {'display_name': 'ZTP', 'fq_name': ['default-global-system-config', 'ztp_template'], 'id_perms': {'created': '2024-10-21T02:01:51.206656', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:51.206656', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9680114959413698706, 'uuid_mslong': 17001638147304409598}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"device_count": {"$id": ' '"/properties/input/properties/device_count", ' '"type": "integer", "title": "The ' 'Device Count Schema", ' '"description": "Number of devices ' 'to discover", "default": 0, ' '"examples": [1, 2, 3, 4, 5]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ebf1f3d1-01cf-49fe-8656-ad44a4cc6092'}, 'oper': 'CREATE', 'request-id': 'req-9402a78c-9787-4354-9bcc-82c6efdedc5d', 'type': 'job_template', 'uuid': 'ebf1f3d1-01cf-49fe-8656-ad44a4cc6092'} 10/21/2024 02:01:51.373 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'fabric_deletion_template'] not found in DB: Unknown id: job_template default-global-system-config:fabric_deletion_template 10/21/2024 02:01:51.373 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:fabric_deletion_template 10/21/2024 02:01:51.405 7fcaff050588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_deletion_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.406 7fcaff050588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_deletion_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.516 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 10/21/2024 02:01:51.517 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_routers' 10/21/2024 02:01:51.517 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 10/21/2024 02:01:51.517 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_refs' 10/21/2024 02:01:51.517 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 10/21/2024 02:01:51.518 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_target_refs' 10/21/2024 02:01:51.518 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 10/21/2024 02:01:51.518 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:51.518 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 10/21/2024 02:01:51.518 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:01:51.518 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 10/21/2024 02:01:51.519 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_aggregate_back_refs' 10/21/2024 02:01:51.519 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 10/21/2024 02:01:51.519 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_policy_back_refs' 10/21/2024 02:01:51.519 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 10/21/2024 02:01:51.519 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_back_refs' 10/21/2024 02:01:51.533 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'obj_dict': {'display_name': 'Fabric Deletion', 'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'id_perms': {'created': '2024-10-21T02:01:51.441911', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:51.441911', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9643276923240194926, 'uuid_mslong': 10266591709339533764}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/delete_fabric.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8e7a42c3-d127-41c4-85d3-cd44f874236e'}, 'oper': 'CREATE', 'request-id': 'req-6104d9dd-047f-4b6e-bde6-ebfe40616c37', 'type': 'job_template', 'uuid': '8e7a42c3-d127-41c4-85d3-cd44f874236e'} 10/21/2024 02:01:51.574 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: bgp_router default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:51.575 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: bgp_router default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:51.589 7fcafefad390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.30", "address": "10.0.0.30", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.589 7fcafefad390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.30", "address": "10.0.0.30", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.624 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.0.0.30', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.0.0.30', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:51.607506', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:51.607506', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11512877978888693239, 'uuid_mslong': 7319917974276620428}}, 'parent_type': 'routing-instance', 'parent_uuid': '23d94074-d92d-4962-a86d-ec011c6e2f3c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6595929d-71c1-408c-9fc5-f5862213e5f7'}, 'oper': 'CREATE', 'request-id': 'req-443d3ad6-5695-4a60-9ba8-515a13fd6378', 'type': 'bgp_router', 'uuid': '6595929d-71c1-408c-9fc5-f5862213e5f7'} 10/21/2024 02:01:51.624 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 10/21/2024 02:01:51.633 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'device_deletion_template'] not found in DB: Unknown id: job_template default-global-system-config:device_deletion_template 10/21/2024 02:01:51.634 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:device_deletion_template 10/21/2024 02:01:51.639 7fcafef8ec18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_deletion_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric_devices.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": 0}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"devices\": {\"type\": \"array\", \"description\": \"List of device names\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.639 7fcafef8ec18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:device_deletion_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "device_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric_devices.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": 0}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"devices\": {\"type\": \"array\", \"description\": \"List of device names\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Device Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.701 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 10/21/2024 02:01:51.701 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zone_refs' 10/21/2024 02:01:51.701 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 10/21/2024 02:01:51.701 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'sub_cluster_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_system_config_back_refs in resource bgp-router: 'global_system_config_back_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_system_config_back_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 10/21/2024 02:01:51.702 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:01:51.703 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 10/21/2024 02:01:51.703 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:01:51.703 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 10/21/2024 02:01:51.703 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_as_a_service_back_refs' 10/21/2024 02:01:51.703 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 10/21/2024 02:01:51.703 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_back_refs' 10/21/2024 02:01:51.717 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'device_deletion_template'], 'obj_dict': {'display_name': 'Device Deletion', 'fq_name': ['default-global-system-config', 'device_deletion_template'], 'id_perms': {'created': '2024-10-21T02:01:51.650665', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:51.650665', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11211894672639127847, 'uuid_mslong': 17320833284640885353}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "devices": ' '{"type": "array", "description": ' '"List of device names", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/delete_fabric_devices.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f05ff61a-48c8-4a69-9b98-a6cd35bff127'}, 'oper': 'CREATE', 'request-id': 'req-e68a3bc9-057c-4500-a513-3d3fdfc09b11', 'type': 'job_template', 'uuid': 'f05ff61a-48c8-4a69-9b98-a6cd35bff127'} 10/21/2024 02:01:51.756 7fcaff0e3f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:01:51.756 7fcaff0e3f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:01:51.756 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { analytics_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16185923586763869294, "uuid_lslong": 13467223589024588416}, "enable": true, "created": "2024-10-21T02:01:48.004211", "last_modified": "2024-10-21T02:01:48.004211", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "e09ff3be-d6ad-4c6e-bae5-308076926280" } deleted = False >> 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.757 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.758 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { config_database_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6474114911615929874, "uuid_lslong": 10216356784971280132}, "enable": true, "created": "2024-10-21T02:01:48.021613", "last_modified": "2024-10-21T02:01:48.021613", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "59d8ad35-f5ed-4e12-8dc7-ca5e0add6f04" } deleted = False >> 10/21/2024 02:01:51.758 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.758 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.758 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.30", "address": "10.0.0.30", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7319917974276620428, "uuid_lslong": 11512877978888693239}, "enable": true, "created": "2024-10-21T02:01:51.607506", "last_modified": "2024-10-21T02:01:51.607506", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "23d94074-d92d-4962-a86d-ec011c6e2f3c"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6595929d-71c1-408c-9fc5-f5862213e5f7" } deleted = False >> 10/21/2024 02:01:51.758 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:01:51.758 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 6 >> 10/21/2024 02:01:51.759 7fcaff0e3f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:51.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:51.819 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:51.819 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:51.819 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:51.820 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:51.821 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:51.822 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:51.823 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:51.823 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:51.825 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:51.826 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:51.827 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:51.828 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:51.828 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:51.828 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:51.828 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:51.828 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:51.828 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:51.829 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:51.829 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:51.829 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:51.830 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:51.830 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:51.830 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:51.830 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:51.830 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource global-system-config: 'bgp_router_refs' 10/21/2024 02:01:51.831 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:01:51.832 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:51.832 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:51.832 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:51.832 7fcafefd0390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:51.841 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'role_assignment_template'] not found in DB: Unknown id: job_template default-global-system-config:role_assignment_template 10/21/2024 02:01:51.841 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:role_assignment_template 10/21/2024 02:01:51.845 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_DNS_refs in resource network-ipam: 'virtual_DNS_refs' 10/21/2024 02:01:51.845 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_DNS_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource network-ipam: 'tag_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource network-ipam: 'virtual_network_back_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_network_back_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_router_back_refs in resource network-ipam: 'virtual_router_back_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_router_back_refs' 10/21/2024 02:01:51.846 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource network-ipam: 'instance_ip_back_refs' 10/21/2024 02:01:51.847 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:01:51.849 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:role_assignment_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "role_assignment_template"], "parent_type": "global-system-config", "job_template_type": "config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/role_assignment.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"role_assignments\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"role_assignments\": {\"type\": \"array\", \"minItems\": 0, \"description\": \"Fabric device role assignments\", \"items\": {\"type\": \"object\", \"properties\": {\"device_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"physical_role\": {\"type\": \"string\", \"enum\": [\"leaf\", \"spine\", \"pnf\", \"superspine\"]}, \"routing_switching_roles\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"enum\": [\"CRB\"]}}}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Role Assignment", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.888 7fcafefd0390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"uuid": "953d4841-c203-4a7e-b905-387930676988", "ref-uuid": "6595929d-71c1-408c-9fc5-f5862213e5f7"} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.905 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'role_assignment_template'], 'obj_dict': {'display_name': 'Role Assignment', 'fq_name': ['default-global-system-config', 'role_assignment_template'], 'id_perms': {'created': '2024-10-21T02:01:51.885428', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:51.885428', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12253286729989231728, 'uuid_mslong': 12448647852194285403}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"role_assignments"], "properties": ' '{"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "role_assignments": ' '{"type": "array", "minItems": 0, ' '"description": "Fabric device role ' 'assignments", "items": {"type": ' '"object", "properties": ' '{"device_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "physical_role": ' '{"type": "string", "enum": ' '["leaf", "spine", "pnf", ' '"superspine"]}, ' '"routing_switching_roles": ' '{"type": "array", "items": ' '{"type": "string", "enum": ' '["CRB"]}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/role_assignment.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'acc27b44-0bf8-475b-aa0c-6b5c38041470'}, 'oper': 'CREATE', 'request-id': 'req-4e51f565-5fa2-4935-bfc3-cd57c0a9ebaa', 'type': 'job_template', 'uuid': 'acc27b44-0bf8-475b-aa0c-6b5c38041470'} 10/21/2024 02:01:51.946 7fcafefd0390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"type": "global-system-config", "uuid": "953d4841-c203-4a7e-b905-387930676988", "ref-type": "bgp-router", "ref-uuid": "6595929d-71c1-408c-9fc5-f5862213e5f7", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-439-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:51.960 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-fb7076cb-da45-4fa4-b355-2a71852e8fa8', 'type': 'global_system_config', 'uuid': '953d4841-c203-4a7e-b905-387930676988'} 10/21/2024 02:01:52.002 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'topology_discovery_template'] not found in DB: Unknown id: job_template default-global-system-config:topology_discovery_template 10/21/2024 02:01:52.002 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:topology_discovery_template 10/21/2024 02:01:52.027 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:topology_discovery_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "topology_discovery_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Topology Discovery", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.102 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'obj_dict': {'display_name': 'Topology Discovery', 'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'id_perms': {'created': '2024-10-21T02:01:52.043222', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.043222', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11777517460580580402, 'uuid_mslong': 965185457927703920}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0d65070f-6a27-4d70-a372-25bafdddbc32'}, 'oper': 'CREATE', 'request-id': 'req-872a3815-a74b-4f1a-83fe-797ac9467372', 'type': 'job_template', 'uuid': '0d65070f-6a27-4d70-a372-25bafdddbc32'} 10/21/2024 02:01:52.199 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'fabric_onboard_template'] not found in DB: Unknown id: job_template default-global-system-config:fabric_onboard_template 10/21/2024 02:01:52.208 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:fabric_onboard_template 10/21/2024 02:01:52.222 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_onboard_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_onboard_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/fabric_onboard.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": true, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 3}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 4}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/role_assignment_dfg.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 5}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 6}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 7}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 8}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 9}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 10}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"management_subnets\", \"loopback_subnets\", \"fabric_subnets\", \"fabric_asn_pool\", \"device_auth\", \"node_profiles\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_display_name\": {\"type\": \"string\"}, \"fabric_cluster_id\": {\"type\": \"integer\"}, \"management_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"description\": \"List of the management network subnets for the fabric\", \"additionalProperties\": false, \"required\": [\"cidr\", \"gateway\"], \"properties\": {\"cidr\": {\"type\": \"string\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}, \"gateway\": {\"type\": \"string\", \"format\": \"ipv4\"}}}}, \"loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"overlay_loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device overlay loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"pnf_servicechain_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for service chaining between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_asn_pool\": {\"type\": \"array\", \"items\": {\"title\": \"eBGP ASN Pool for fabric underlay network\", \"type\": \"object\", \"description\": \"List of the ASN pools that could be used to configure the eBGP peers for the IP fabric\", \"properties\": {\"asn_min\": {\"type\": \"integer\"}, \"asn_max\": {\"type\": \"integer\"}}, \"required\": [\"asn_min\", \"asn_max\"]}}, \"overlay_ibgp_asn\": {\"type\": \"integer\", \"title\": \"iBGP ASN for Contrail overlay network\", \"default\": 64512}, \"device_auth\": {\"title\": \"Device Auth\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"root_password\"], \"properties\": {\"root_password\": {\"type\": \"string\"}}}, \"node_profiles\": {\"type\": \"array\", \"items\": {\"title\": \"Node profile\", \"type\": \"object\", \"description\": \"List of node profiles to be used by the fabric.\", \"additionalProperties\": false, \"properties\": {\"node_profile_name\": {\"type\": \"string\"}, \"serial_nums\": {\"type\": \"array\", \"description\": \"Optional list of serial numbers of fabric devices that we want to associate with this node profile.\", \"items\": {\"type\": \"string\"}}}, \"required\": [\"node_profile_name\"]}}, \"interface_filters\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}, \"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported as part of onboarding.\"}, \"device_count\": {\"title\": \"Number of fabric devices\", \"type\": \"integer\", \"description\": \"Total number of devices in the fabric that needs to be zero-touch provisioned\"}, \"ztp_timeout\": {\"title\": \"Value of ZTP timeout in seconds\", \"type\": \"integer\", \"description\": \"Value of ZTP timeout in seconds\"}, \"retry_timeout\": {\"title\": \"Value of retry timeout in seconds\", \"type\": \"integer\", \"description\": \"Value of retry timeout in seconds\"}, \"supplemental_day_0_cfg\": {\"title\": \"List of day 0 config that can be used to supplement the ZTP config\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"required\": [\"name\", \"cfg\"], \"properties\": {\"name\": {\"title\": \"name for the config\", \"type\": \"string\"}, \"cfg\": {\"title\": \"config blob that contains the supplemental day-0 config\", \"type\": \"string\"}}}}, \"device_to_ztp\": {\"title\": \"List of device serial numbers for the devices to be ZTPed\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"required\": [\"serial_number\", \"hostname\"], \"properties\": {\"serial_number\": {\"title\": \"Device serial number\", \"type\": \"string\"}, \"hostname\": {\"title\": \"Device hostname can be optionally specified.\", \"type\": \"string\", \"pattern\": \"^(([a-zA-Z0-9]|[a-zA-Z0-9][a-zA-Z0-9\\\\-]*[a-zA-Z0-9])\\\\.)*([A-Za-z0-9]|[A-Za-z0-9][A-Za-z0-9\\\\-]*[A-Za-z0-9])$\"}, \"underlay_asn\": {\"title\": \"Underlay eBGP autonomous system number\", \"type\": [\"integer\", \"string\"]}, \"loopback_ip\": {\"title\": \"Loopback IP address\", \"type\": \"string\", \"format\": \"ipv4\"}, \"mgmt_ip\": {\"title\": \"Management IP address\", \"type\": \"string\", \"format\": \"ipv4\"}, \"to_ztp\": {\"title\": \"Include or ignore device in ZTP workflow\", \"type\": \"boolean\"}, \"supplemental_day_0_cfg\": {\"title\": \"Name(s) of the supplemental day-0 config(s) that can be optionally specified for this device\", \"type\": [\"string\", \"array\"], \"items\": {\"type\": \"string\"}}}}}, \"os_version\": {\"type\": \"string\"}, \"enterprise_style\": {\"type\": \"boolean\", \"default\": true, \"description\": \"True if enterprise style, false if sp-style configuration\"}, \"disable_vlan_vn_uniqueness_check\": {\"type\": \"boolean\", \"default\": false, \"description\": \"True if vlan-vn uniqueness validation checks needs to be disabled, false if enable all complex validations\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Onboarding", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.311 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'obj_dict': {'display_name': 'Fabric Onboarding', 'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'id_perms': {'created': '2024-10-21T02:01:52.237982', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.237982', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13319509765510079733, 'uuid_mslong': 1088698170357203182}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"management_subnets", ' '"loopback_subnets", ' '"fabric_subnets", ' '"fabric_asn_pool", "device_auth", ' '"node_profiles"], "properties": ' '{"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_display_name": ' '{"type": "string"}, ' '"fabric_cluster_id": {"type": ' '"integer"}, "management_subnets": ' '{"type": "array", "items": ' '{"type": "object", "description": ' '"List of the management network ' 'subnets for the fabric", ' '"additionalProperties": false, ' '"required": ["cidr", "gateway"], ' '"properties": {"cidr": {"type": ' '"string", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}, ' '"gateway": {"type": "string", ' '"format": "ipv4"}}}}, ' '"loopback_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that fabric ' 'device loopback ips can be ' 'allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"overlay_loopback_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'fabric device overlay loopback ips ' 'can be allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that could be ' 'carved out for the p2p networks ' 'between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"pnf_servicechain_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for service ' 'chaining between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_asn_pool": {"type": ' '"array", "items": {"title": "eBGP ' 'ASN Pool for fabric underlay ' 'network", "type": "object", ' '"description": "List of the ASN ' 'pools that could be used to ' 'configure the eBGP peers for the ' 'IP fabric", "properties": ' '{"asn_min": {"type": "integer"}, ' '"asn_max": {"type": "integer"}}, ' '"required": ["asn_min", ' '"asn_max"]}}, "overlay_ibgp_asn": ' '{"type": "integer", "title": "iBGP ' 'ASN for Contrail overlay network", ' '"default": 64512}, "device_auth": ' '{"title": "Device Auth", "type": ' '"object", "additionalProperties": ' 'false, "required": ' '["root_password"], "properties": ' '{"root_password": {"type": ' '"string"}}}, "node_profiles": ' '{"type": "array", "items": ' '{"title": "Node profile", "type": ' '"object", "description": "List of ' 'node profiles to be used by the ' 'fabric.", "additionalProperties": ' 'false, "properties": ' '{"node_profile_name": {"type": ' '"string"}, "serial_nums": {"type": ' '"array", "description": "Optional ' 'list of serial numbers of fabric ' 'devices that we want to associate ' 'with this node profile.", "items": ' '{"type": "string"}}}, "required": ' '["node_profile_name"]}}, ' '"interface_filters": {"type": ' '"array", "items": {"type": ' '"object", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}, ' '"import_configured": {"type": ' '"boolean", "default": false, ' '"description": "Not importing ' 'configured interfaces by default. ' 'Set this option to true if ' 'configured interfaces need to be ' 'imported as part of onboarding."}, ' '"device_count": {"title": "Number ' 'of fabric devices", "type": ' '"integer", "description": "Total ' 'number of devices in the fabric ' 'that needs to be zero-touch ' 'provisioned"}, "ztp_timeout": ' '{"title": "Value of ZTP timeout in ' 'seconds", "type": "integer", ' '"description": "Value of ZTP ' 'timeout in seconds"}, ' '"retry_timeout": {"title": "Value ' 'of retry timeout in seconds", ' '"type": "integer", "description": ' '"Value of retry timeout in ' 'seconds"}, ' '"supplemental_day_0_cfg": ' '{"title": "List of day 0 config ' 'that can be used to supplement the ' 'ZTP config", "type": "array", ' '"items": {"type": "object", ' '"required": ["name", "cfg"], ' '"properties": {"name": {"title": ' '"name for the config", "type": ' '"string"}, "cfg": {"title": ' '"config blob that contains the ' 'supplemental day-0 config", ' '"type": "string"}}}}, ' '"device_to_ztp": {"title": "List ' 'of device serial numbers for the ' 'devices to be ZTPed", "type": ' '"array", "items": {"type": ' '"object", "required": ' '["serial_number", "hostname"], ' '"properties": {"serial_number": ' '{"title": "Device serial number", ' '"type": "string"}, "hostname": ' '{"title": "Device hostname can be ' 'optionally specified.", "type": ' '"string", "pattern": ' '"^(([a-zA-Z0-9]|[a-zA-Z0-9][a-zA-Z0-9\\\\-]*[a-zA-Z0-9])\\\\.)*([A-Za-z0-9]|[A-Za-z0-9][A-Za-z0-9\\\\-]*[A-Za-z0-9])$"}, ' '"underlay_asn": {"title": ' '"Underlay eBGP autonomous system ' 'number", "type": ["integer", ' '"string"]}, "loopback_ip": ' '{"title": "Loopback IP address", ' '"type": "string", "format": ' '"ipv4"}, "mgmt_ip": {"title": ' '"Management IP address", "type": ' '"string", "format": "ipv4"}, ' '"to_ztp": {"title": "Include or ' 'ignore device in ZTP workflow", ' '"type": "boolean"}, ' '"supplemental_day_0_cfg": ' '{"title": "Name(s) of the ' 'supplemental day-0 config(s) that ' 'can be optionally specified for ' 'this device", "type": ["string", ' '"array"], "items": {"type": ' '"string"}}}}}, "os_version": ' '{"type": "string"}, ' '"enterprise_style": {"type": ' '"boolean", "default": true, ' '"description": "True if enterprise ' 'style, false if sp-style ' 'configuration"}, ' '"disable_vlan_vn_uniqueness_check": ' '{"type": "boolean", "default": ' 'false, "description": "True if ' 'vlan-vn uniqueness validation ' 'checks needs to be disabled, false ' 'if enable all complex ' 'validations"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_onboard.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': True, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 4, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/role_assignment_dfg.yml', 'refresh_token': False, 'sequence_no': 5, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': 6, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': 7, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 8, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 9, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 10, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0f1bd537-bfc2-40ee-b8d8-678fdb9324f5'}, 'oper': 'CREATE', 'request-id': 'req-8d403d21-5f33-49e6-935a-ea98a52de4d8', 'type': 'job_template', 'uuid': '0f1bd537-bfc2-40ee-b8d8-678fdb9324f5'} 10/21/2024 02:01:52.405 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'search_ip_mac_template'] not found in DB: Unknown id: job_template default-global-system-config:search_ip_mac_template 10/21/2024 02:01:52.406 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:search_ip_mac_template 10/21/2024 02:01:52.412 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:search_ip_mac_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "search_ip_mac_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ip_address\": {\"$id\": \"/properties/ip_address\", \"title\": \"IP Address\", \"pattern\": \"^\\\\s*(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5]).){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\\\\s*$\", \"type\": \"string\"}, \"mac_address\": {\"$id\": \"/properties/mac_address\", \"title\": \"Mac Address\", \"pattern\": \"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Search ip or mac schema command Playbook Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"interface_names\": {\"type\": \"array\", \"title\": \"Interfaces Name(s)\", \"description\": \"Display Interface Names that belong to this mac_address.\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface Name\", \"description\": \"Interface name\"}, \"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"Device name on which the interface was learnt\"}, \"loopback_ip\": {\"type\": \"string\", \"title\": \"Source Loopback IP\", \"description\": \"Originating source's loopback ip address\"}}, \"description\": \"Name of each interface that belongs under this mac_address\"}}}}}}}}}", "job_template_input_ui_schema": "{\"ip_address\": {\"ui:help\": \"Enter an IP Address. The field value must include a IPv4 address without subnet mask; for example, 192.168.3.120\", \"ui:placeholder\": \"Enter IP address\"}, \"mac_address\": {\"ui:help\": \"Enter a 48 bit MAC address in colon separated format; for example, 00:00:0A:BB:28:FC\", \"ui:placeholder\": \"Enter MAC address\"}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to locate an interface in a fabric given an IP or MAC", "display_name": "Search using IP or MAC", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.484 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'obj_dict': {'display_name': 'Search using IP or MAC', 'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'id_perms': {'created': '2024-10-21T02:01:52.426679', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.426679', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10177288897360310960, 'uuid_mslong': 15053488902925008955}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to locate an ' 'interface in a fabric given an IP ' 'or MAC', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"ip_address": ' '{"$id": "/properties/ip_address", ' '"title": "IP Address", "pattern": ' '"^\\\\s*(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5]).){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\\\\s*$", ' '"type": "string"}, "mac_address": ' '{"$id": "/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}}', 'job_template_input_ui_schema': '{"ip_address": {"ui:help": ' '"Enter an IP Address. The field ' 'value must include a IPv4 ' 'address without subnet mask; ' 'for example, 192.168.3.120", ' '"ui:placeholder": "Enter IP ' 'address"}, "mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Search ip or mac schema ' 'command Playbook Output", "type": ' '"object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"interface_names": {"type": ' '"array", "title": "Interfaces ' 'Name(s)", "description": "Display ' 'Interface Names that belong to ' 'this mac_address.", "items": ' '{"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string", "title": "Interface ' 'Name", "description": "Interface ' 'name"}, "device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "Device name on ' 'which the interface was learnt"}, ' '"loopback_ip": {"type": "string", ' '"title": "Source Loopback IP", ' '"description": "Originating ' 'source\'s loopback ip address"}}, ' '"description": "Name of each ' 'interface that belongs under this ' 'mac_address"}}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd0e8bc66-8121-403b-8d3c-fe549fb032b0'}, 'oper': 'CREATE', 'request-id': 'req-9ee12b34-e042-4421-ad73-4b6fc7b595cd', 'type': 'job_template', 'uuid': 'd0e8bc66-8121-403b-8d3c-fe549fb032b0'} 10/21/2024 02:01:52.512 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'] not found in DB: Unknown id: access_control_list default-domain:default-project:__no_rule__:ingress-access-control-list 10/21/2024 02:01:52.513 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: access_control_list default-domain:default-project:__no_rule__:ingress-access-control-list 10/21/2024 02:01:52.520 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:ingress-access-control-list url = https://10.0.0.30:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "ingress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ingress-access-control-list"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.540 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2024-10-21T02:01:52.533054', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.533054', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12961215893892963828, 'uuid_mslong': 3718263383255108879}}, 'parent_type': 'security-group', 'parent_uuid': '55f9ab38-3e1a-4492-98d5-fc938de482ef', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3399ecd8-cc43-4d0f-b3df-7d2f1ca31df4'}, 'oper': 'CREATE', 'request-id': 'req-4c8f995f-d81c-4bf0-83da-3431106d9e78', 'type': 'access_control_list', 'uuid': '3399ecd8-cc43-4d0f-b3df-7d2f1ca31df4'} 10/21/2024 02:01:52.587 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_interface_details_template'] not found in DB: Unknown id: job_template default-global-system-config:show_interface_details_template 10/21/2024 02:01:52.588 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:show_interface_details_template 10/21/2024 02:01:52.596 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_interface_details_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_interface_details_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"interface_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Interface Details\", \"type\": \"object\", \"properties\": {\"interface_type\": {\"type\": \"string\", \"title\": \"Interface Type\", \"enum\": [\"physical\", \"logical\"], \"default\": \"physical\"}}, \"required\": [\"interface_type\"]}, \"conditional\": {\"title\": \"Sub Operation Type\", \"$ref\": \"#/definitions/sub_command\"}}, \"definitions\": {\"sub_command\": {\"title\": \"Sub Operation Type\", \"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"Show runtime interfaces\", \"Show configured interfaces\", \"Show interfaces by names\"], \"default\": \"Show runtime interfaces\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"Show runtime interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show configured interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show interfaces by names\"]}, \"interface_names\": {\"$id\": \"/properties/interface_names\", \"title\": \"Interface Names\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_names/items\", \"type\": \"string\", \"pattern\": \"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$\", \"title\": \"Interface Name\"}, \"examples\": [\"ge-0/0/1\", \"xe-0/0/0\"]}}, \"required\": [\"interface_names\"]}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show Interface Details Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces details sub-command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"oneOf\": [{\"properties\": {\"interface_stats_rt_phy\": {\"type\": \"array\", \"title\": \"Runtime Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"op_status\": {\"type\": \"string\", \"title\": \"Operational Status\", \"description\": \"Operational status of the interface\"}, \"admin_status\": {\"type\": \"string\", \"title\": \"Admin Status\", \"description\": \"Admin status of the interface\"}, \"input_rate\": {\"type\": \"string\", \"title\": \"InputRate (bps)\", \"description\": \"Input packets rate in bits per second if present\"}, \"output_rate\": {\"type\": \"string\", \"title\": \"OutputRate (bps)\", \"description\": \"Output packets rate in bits per second if present\"}}}}}}, {\"properties\": {\"interface_stats_log\": {\"type\": \"array\", \"title\": \"Logical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"address_family\": {\"type\": \"string\", \"title\": \"Address Family\", \"description\": \"Address family if present\"}}}}}}, {\"properties\": {\"interface_stats_cf_phy\": {\"type\": \"array\", \"title\": \"Configured Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}}}}}}]}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to get a list of physical or logical interfaces from a device and interfaces' other related information.", "display_name": "Show Interface Details", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.645 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'] not found in DB: Unknown id: access_control_list default-domain:default-project:__no_rule__:egress-access-control-list 10/21/2024 02:01:52.646 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: access_control_list default-domain:default-project:__no_rule__:egress-access-control-list 10/21/2024 02:01:52.668 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'obj_dict': {'display_name': 'Show Interface Details', 'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'id_perms': {'created': '2024-10-21T02:01:52.611449', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.611449', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12247336935734669736, 'uuid_mslong': 7985281776446423871}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to get a list ' 'of physical or logical interfaces ' "from a device and interfaces' other " 'related information.', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"interface_details": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Interface Details", ' '"type": "object", "properties": ' '{"interface_type": {"type": ' '"string", "title": "Interface ' 'Type", "enum": ["physical", ' '"logical"], "default": ' '"physical"}}, "required": ' '["interface_type"]}, ' '"conditional": {"title": "Sub ' 'Operation Type", "$ref": ' '"#/definitions/sub_command"}}, ' '"definitions": {"sub_command": ' '{"title": "Sub Operation Type", ' '"type": "object", "properties": ' '{"sub_operation": {"title": ' '"Choose a sub-operation", "type": ' '"string", "enum": ["Show runtime ' 'interfaces", "Show configured ' 'interfaces", "Show interfaces by ' 'names"], "default": "Show runtime ' 'interfaces"}}, "required": ' '["sub_operation"], "dependencies": ' '{"sub_operation": {"oneOf": ' '[{"properties": {"sub_operation": ' '{"enum": ["Show runtime ' 'interfaces"]}, ' '"interface_filters": {"$id": ' '"/properties/interface_filters", ' '"title": "Interface Filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "title": ' '"Filter", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"], "title": "Filter ' 'Type"}, "expr": {"type": "string", ' '"title": "Filter Expression"}}, ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["Show configured ' 'interfaces"]}, ' '"interface_filters": {"$id": ' '"/properties/interface_filters", ' '"title": "Interface Filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "title": ' '"Filter", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"], "title": "Filter ' 'Type"}, "expr": {"type": "string", ' '"title": "Filter Expression"}}, ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["Show interfaces by ' 'names"]}, "interface_names": ' '{"$id": ' '"/properties/interface_names", ' '"title": "Interface Names", ' '"type": "array", "items": {"$id": ' '"/properties/interface_names/items", ' '"type": "string", "pattern": ' '"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$", ' '"title": "Interface Name"}, ' '"examples": ["ge-0/0/1", ' '"xe-0/0/0"]}}, "required": ' '["interface_names"]}]}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show Interface Details ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces details ' 'sub-command executed on the ' 'device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "oneOf": ' '[{"properties": ' '{"interface_stats_rt_phy": ' '{"type": "array", "title": ' '"Runtime Physical Interfaces ' 'Statistics", "description": ' '"Display statistics and detailed ' 'output", "items": {"type": ' '"object", "additionalProperties": ' 'false, "properties": {"name": ' '{"type": "string", "title": ' '"Interface", "description": ' '"Interface name"}, "op_status": ' '{"type": "string", "title": ' '"Operational Status", ' '"description": "Operational ' 'status of the interface"}, ' '"admin_status": {"type": ' '"string", "title": "Admin ' 'Status", "description": "Admin ' 'status of the interface"}, ' '"input_rate": {"type": "string", ' '"title": "InputRate (bps)", ' '"description": "Input packets ' 'rate in bits per second if ' 'present"}, "output_rate": ' '{"type": "string", "title": ' '"OutputRate (bps)", ' '"description": "Output packets ' 'rate in bits per second if ' 'present"}}}}}}, {"properties": ' '{"interface_stats_log": {"type": ' '"array", "title": "Logical ' 'Interfaces Statistics", ' '"description": "Display ' 'statistics and detailed output", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string", "title": "Interface", ' '"description": "Interface name"}, ' '"address_family": {"type": ' '"string", "title": "Address ' 'Family", "description": "Address ' 'family if present"}}}}}}, ' '{"properties": ' '{"interface_stats_cf_phy": ' '{"type": "array", "title": ' '"Configured Physical Interfaces ' 'Statistics", "description": ' '"Display statistics and detailed ' 'output", "items": {"type": ' '"object", "additionalProperties": ' 'false, "properties": {"name": ' '{"type": "string", "title": ' '"Interface", "description": ' '"Interface name"}}}}}}]}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6ed16b77-c47d-433f-a9f7-480dcafc71a8'}, 'oper': 'CREATE', 'request-id': 'req-a6826fc8-724a-4d73-afca-3dbcb0c10090', 'type': 'job_template', 'uuid': '6ed16b77-c47d-433f-a9f7-480dcafc71a8'} 10/21/2024 02:01:52.674 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = https://10.0.0.30:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "egress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "egress-access-control-list"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.724 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2024-10-21T02:01:52.698210', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.698210', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12279677056551822753, 'uuid_mslong': 8996018227519310286}}, 'parent_type': 'security-group', 'parent_uuid': '55f9ab38-3e1a-4492-98d5-fc938de482ef', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7cd846ea-3c3a-49ce-aa6a-2d38f04925a1'}, 'oper': 'CREATE', 'request-id': 'req-6ba579d9-a3c8-44b5-83b7-22bd8a05f420', 'type': 'access_control_list', 'uuid': '7cd846ea-3c3a-49ce-aa6a-2d38f04925a1'} 10/21/2024 02:01:52.762 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_config_template'] not found in DB: Unknown id: job_template default-global-system-config:show_config_template 10/21/2024 02:01:52.762 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:show_config_template 10/21/2024 02:01:52.768 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_config_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_config_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"config_type\": {\"$id\": \"/properties/config_type\", \"title\": \"Configuration type\", \"type\": \"string\", \"enum\": [\"current\", \"rollback 1\", \"rollback 2\"], \"default\": \"current\"}, \"config_filter\": {\"$id\": \"/properties/config_filter\", \"title\": \"Configuration filter\", \"type\": \"string\", \"enum\": [\"all\", \"system\", \"system/login\", \"system/services\", \"system/syslog\", \"interfaces\", \"chassis\", \"services\", \"snmp\", \"forwarding-options\", \"event-options\", \"policy-options\", \"class-of-service\", \"firewall\", \"protocols\", \"routing-instances\", \"routing-options\", \"switch-options\", \"vlans\"], \"default\": \"all\"}, \"compare_configurations\": {\"$id\": \"/properties/compare_configurations\", \"title\": \"Compare selected configuration with current\", \"type\": \"boolean\", \"default\": false}}, \"required\": [\"config_type\", \"config_filter\", \"compare_configurations\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show configuration Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Device Configuration\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "{\"config_type\": {\"ui:help\": \"Select one type at a time\"}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display current or previous configuration", "display_name": " Show current or rollback configuration", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:52.807 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000000'] not found in DB: Unknown id: route_target target:64512:8000000 10/21/2024 02:01:52.807 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: route_target target:64512:8000000 10/21/2024 02:01:52.807 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000000 url = https://10.0.0.30:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000000"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.835 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_config_template'], 'obj_dict': {'display_name': ' Show current or rollback configuration', 'fq_name': ['default-global-system-config', 'show_config_template'], 'id_perms': {'created': '2024-10-21T02:01:52.782816', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.782816', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10308503859898257894, 'uuid_mslong': 15258294337391511080}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'current or previous configuration', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"config_type": ' '{"$id": "/properties/config_type", ' '"title": "Configuration type", ' '"type": "string", "enum": ' '["current", "rollback 1", ' '"rollback 2"], "default": ' '"current"}, "config_filter": ' '{"$id": ' '"/properties/config_filter", ' '"title": "Configuration filter", ' '"type": "string", "enum": ["all", ' '"system", "system/login", ' '"system/services", ' '"system/syslog", "interfaces", ' '"chassis", "services", "snmp", ' '"forwarding-options", ' '"event-options", "policy-options", ' '"class-of-service", "firewall", ' '"protocols", "routing-instances", ' '"routing-options", ' '"switch-options", "vlans"], ' '"default": "all"}, ' '"compare_configurations": {"$id": ' '"/properties/compare_configurations", ' '"title": "Compare selected ' 'configuration with current", ' '"type": "boolean", "default": ' 'false}}, "required": ' '["config_type", "config_filter", ' '"compare_configurations"]}', 'job_template_input_ui_schema': '{"config_type": {"ui:help": ' '"Select one type at a time"}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show configuration ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Device ' 'Configuration", "description": ' '"Display Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd3c059db-a293-4628-8f0f-29a4cefa91e6'}, 'oper': 'CREATE', 'request-id': 'req-155b969c-ff48-4c55-b141-22ae03e4fa15', 'type': 'job_template', 'uuid': 'd3c059db-a293-4628-8f0f-29a4cefa91e6'} 10/21/2024 02:01:52.850 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2024-10-21T02:01:52.827670', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.827670', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12308293068747573718, 'uuid_mslong': 6976053693501032428}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '60cfebdf-9f2e-47ec-aacf-d7557a1a09d6'}, 'oper': 'CREATE', 'request-id': 'req-b6f363ba-965b-4f3c-a42a-59cf94223dfc', 'type': 'route_target', 'uuid': '60cfebdf-9f2e-47ec-aacf-d7557a1a09d6'} 10/21/2024 02:01:52.876 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1a05838d-2dd2-48a4-98d0-eafce7fcbc46 object_type = routing_instance identifier_name = default-domain:default-project:dci-network:__default__ url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"type": "routing-instance", "uuid": "1a05838d-2dd2-48a4-98d0-eafce7fcbc46", "ref-type": "route-target", "ref-uuid": "60cfebdf-9f2e-47ec-aacf-d7557a1a09d6", "ref-fq-name": ["target:64512:8000000"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.906 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-6b606df5-005d-46ab-b9a9-de9e4e007421', 'type': 'routing_instance', 'uuid': '1a05838d-2dd2-48a4-98d0-eafce7fcbc46'} 10/21/2024 02:01:52.944 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'test_overlay_connectivity_template'] not found in DB: Unknown id: job_template default-global-system-config:test_overlay_connectivity_template 10/21/2024 02:01:52.945 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:test_overlay_connectivity_template 10/21/2024 02:01:52.950 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:test_overlay_connectivity_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "test_overlay_connectivity_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"source_ip\": {\"$id\": \"/properties/source_ip\", \"title\": \"Source (device loopback IP)\", \"type\": \"string\", \"default\": \"\"}, \"destination_ip\": {\"$id\": \"/properties/destination_ip\", \"title\": \"Destination (device loopback IP)\", \"type\": \"string\", \"default\": \"\"}, \"vni\": {\"$id\": \"/properties/vni\", \"title\": \"VNI\", \"type\": \"integer\", \"default\": 100}, \"count\": {\"$id\": \"/properties/count\", \"title\": \"Packet count\", \"type\": \"integer\", \"default\": 5}}, \"required\": [\"source_ip\", \"destination_ip\", \"count\", \"vni\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show connectivity test report\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Each playbook's command_output for this specific command.\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Connectivity test report\", \"description\": \"Display connectivity test report\"}}}}}}}}", "job_template_input_ui_schema": "{\"destination_ip\": {\"ui:help\": \"\"}}", "job_template_output_ui_schema": "null", "job_template_description": "", "display_name": "Test overlay connectivity", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:52.994 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000001'] not found in DB: Unknown id: route_target target:64512:8000001 10/21/2024 02:01:52.995 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: route_target target:64512:8000001 10/21/2024 02:01:52.995 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000001 url = https://10.0.0.30:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000001"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000001"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.051 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'obj_dict': {'display_name': 'Test overlay connectivity', 'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'id_perms': {'created': '2024-10-21T02:01:52.985137', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:52.985137', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12131714130182068196, 'uuid_mslong': 1263676805218717000}}, 'job_template_concurrency_level': 'device', 'job_template_description': '', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"source_ip": ' '{"$id": "/properties/source_ip", ' '"title": "Source (device loopback ' 'IP)", "type": "string", "default": ' '""}, "destination_ip": {"$id": ' '"/properties/destination_ip", ' '"title": "Destination (device ' 'loopback IP)", "type": "string", ' '"default": ""}, "vni": {"$id": ' '"/properties/vni", "title": "VNI", ' '"type": "integer", "default": ' '100}, "count": {"$id": ' '"/properties/count", "title": ' '"Packet count", "type": "integer", ' '"default": 5}}, "required": ' '["source_ip", "destination_ip", ' '"count", "vni"]}', 'job_template_input_ui_schema': '{"destination_ip": {"ui:help": ' '""}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show connectivity test ' 'report", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Each playbook\'s ' 'command_output for this specific ' 'command.", "properties": ' '{"config_output": {"type": ' '"string", "title": "Connectivity ' 'test report", "description": ' '"Display connectivity test ' 'report"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '11897b5b-edf6-4d48-a85c-81b98e16d7e4'}, 'oper': 'CREATE', 'request-id': 'req-32945a7a-017a-4507-821e-7ddb8fc11af7', 'type': 'job_template', 'uuid': '11897b5b-edf6-4d48-a85c-81b98e16d7e4'} 10/21/2024 02:01:53.057 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2024-10-21T02:01:53.031536', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.031536', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13556540581751660265, 'uuid_mslong': 8662491448035266542}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '78375a13-7e00-4fee-bc22-81d55e799ee9'}, 'oper': 'CREATE', 'request-id': 'req-7f52203e-8f1c-46ff-8309-10142039dd1c', 'type': 'route_target', 'uuid': '78375a13-7e00-4fee-bc22-81d55e799ee9'} 10/21/2024 02:01:53.060 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2eba0cc3-5657-4d99-ae8f-aae1bdcca0ef object_type = routing_instance identifier_name = default-domain:default-project:dci-network:dci-network url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"type": "routing-instance", "uuid": "2eba0cc3-5657-4d99-ae8f-aae1bdcca0ef", "ref-type": "route-target", "ref-uuid": "78375a13-7e00-4fee-bc22-81d55e799ee9", "ref-fq-name": ["target:64512:8000001"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.081 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-b1a12135-843d-461b-9c17-6fb772ff4427', 'type': 'routing_instance', 'uuid': '2eba0cc3-5657-4d99-ae8f-aae1bdcca0ef'} 10/21/2024 02:01:53.143 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000002'] not found in DB: Unknown id: route_target target:64512:8000002 10/21/2024 02:01:53.143 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: route_target target:64512:8000002 10/21/2024 02:01:53.144 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000002 url = https://10.0.0.30:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000002"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000002"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.145 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_ops_info_template'] not found in DB: Unknown id: job_template default-global-system-config:show_ops_info_template 10/21/2024 02:01:53.146 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:show_ops_info_template 10/21/2024 02:01:53.150 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_ops_info_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_ops_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ops_type\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Operations commands\", \"type\": \"array\", \"minItems\": 1, \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"minProperties\": 1, \"additionalProperties\": false, \"properties\": {\"conditional\": {\"title\": \"Operation Command Type\", \"$ref\": \"#/definitions/sub_command\"}}}}}, \"definitions\": {\"sub_command\": {\"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"show chassis info\", \"show route info\", \"show bgp info\", \"show evpn info\", \"show lldp info\", \"show lacp info\", \"show vlan info\"], \"default\": \"show route info\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"show chassis info\"]}, \"command_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis alarms\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show route info\"]}, \"command_detail\": {\"$id\": \"/properties/route_detail\", \"title\": \"Route detail\", \"type\": \"string\", \"enum\": [\"route summary\"], \"default\": \"route summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show bgp info\"]}, \"command_detail\": {\"$id\": \"/properties/bgp_detail\", \"title\": \"BGP detail\", \"type\": \"string\", \"enum\": [\"bgp summary\", \"bgp neighbor\", \"bgp group\"], \"default\": \"bgp summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show evpn info\"]}, \"command_detail\": {\"$id\": \"/properties/evpn_detail\", \"title\": \"EVPN detail\", \"type\": \"string\", \"enum\": [\"evpn ip-prefix-database\", \"evpn instance extensive\", \"evpn instance designated-forwarder\", \"evpn instance backup-forwarder\", \"evpn database state default-gateway\"], \"default\": \"evpn ip-prefix-database\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lldp info\"]}, \"command_detail\": {\"$id\": \"/properties/lldp_detail\", \"title\": \"LLDP detail\", \"type\": \"string\", \"enum\": [\"lldp neighbors\"], \"default\": \"lldp neighbors\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lacp info\"]}, \"command_detail\": {\"$id\": \"/properties/lacp_detail\", \"title\": \"LACP detail\", \"type\": \"string\", \"enum\": [\"lacp interfaces extensive\", \"lacp statistics interfaces\"], \"default\": \"lacp interfaces extensive\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show vlan info\"]}, \"command_detail\": {\"$id\": \"/properties/vlan_detail\", \"title\": \"VLAN detail\", \"type\": \"string\", \"enum\": [\"vlans\"], \"default\": \"vlans\"}}}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display operational information", "display_name": "Show operations information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.160 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2024-10-21T02:01:53.151882', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.151882', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11964398018132136186, 'uuid_mslong': 16382349514928112954}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'e359cc16-1f95-453a-a60a-149b7e2750fa'}, 'oper': 'CREATE', 'request-id': 'req-918901cf-75d2-415a-9927-9d6316e56bbf', 'type': 'route_target', 'uuid': 'e359cc16-1f95-453a-a60a-149b7e2750fa'} 10/21/2024 02:01:53.235 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 8e903556-5a15-4923-8cdb-758b07e9606f object_type = routing_instance identifier_name = default-domain:default-project:default-virtual-network:default-virtual-network url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"type": "routing-instance", "uuid": "8e903556-5a15-4923-8cdb-758b07e9606f", "ref-type": "route-target", "ref-uuid": "e359cc16-1f95-453a-a60a-149b7e2750fa", "ref-fq-name": ["target:64512:8000002"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.259 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'obj_dict': {'display_name': 'Show operations information', 'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'id_perms': {'created': '2024-10-21T02:01:53.174907', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.174907', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13742565163276695965, 'uuid_mslong': 549554029413944941}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'operational information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"ops_type": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Operations commands", ' '"type": "array", "minItems": 1, ' '"items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "minProperties": ' '1, "additionalProperties": false, ' '"properties": {"conditional": ' '{"title": "Operation Command ' 'Type", "$ref": ' '"#/definitions/sub_command"}}}}}, ' '"definitions": {"sub_command": ' '{"type": "object", "properties": ' '{"sub_operation": {"title": ' '"Choose a sub-operation", "type": ' '"string", "enum": ["show chassis ' 'info", "show route info", "show ' 'bgp info", "show evpn info", "show ' 'lldp info", "show lacp info", ' '"show vlan info"], "default": ' '"show route info"}}, "required": ' '["sub_operation"], "dependencies": ' '{"sub_operation": {"oneOf": ' '[{"properties": {"sub_operation": ' '{"enum": ["show chassis info"]}, ' '"command_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis alarms"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show route info"]}, ' '"command_detail": {"$id": ' '"/properties/route_detail", ' '"title": "Route detail", "type": ' '"string", "enum": ["route ' 'summary"], "default": "route ' 'summary"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'bgp info"]}, "command_detail": ' '{"$id": "/properties/bgp_detail", ' '"title": "BGP detail", "type": ' '"string", "enum": ["bgp summary", ' '"bgp neighbor", "bgp group"], ' '"default": "bgp summary"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show evpn info"]}, ' '"command_detail": {"$id": ' '"/properties/evpn_detail", ' '"title": "EVPN detail", "type": ' '"string", "enum": ["evpn ' 'ip-prefix-database", "evpn ' 'instance extensive", "evpn ' 'instance designated-forwarder", ' '"evpn instance backup-forwarder", ' '"evpn database state ' 'default-gateway"], "default": ' '"evpn ip-prefix-database"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show lldp info"]}, ' '"command_detail": {"$id": ' '"/properties/lldp_detail", ' '"title": "LLDP detail", "type": ' '"string", "enum": ["lldp ' 'neighbors"], "default": "lldp ' 'neighbors"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'lacp info"]}, "command_detail": ' '{"$id": "/properties/lacp_detail", ' '"title": "LACP detail", "type": ' '"string", "enum": ["lacp ' 'interfaces extensive", "lacp ' 'statistics interfaces"], ' '"default": "lacp interfaces ' 'extensive"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'vlan info"]}, "command_detail": ' '{"$id": "/properties/vlan_detail", ' '"title": "VLAN detail", "type": ' '"string", "enum": ["vlans"], ' '"default": "vlans"}}}]}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '07a0687a-641a-4e6d-beb7-66346bc3f99d'}, 'oper': 'CREATE', 'request-id': 'req-33e60d86-e3e0-4a8d-9bb6-1d2cd27e5b81', 'type': 'job_template', 'uuid': '07a0687a-641a-4e6d-beb7-66346bc3f99d'} 10/21/2024 02:01:53.274 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-ba3020aa-fe1f-4963-9dbb-1f1942fc0467', 'type': 'routing_instance', 'uuid': '8e903556-5a15-4923-8cdb-758b07e9606f'} 10/21/2024 02:01:53.337 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000003'] not found in DB: Unknown id: route_target target:64512:8000003 10/21/2024 02:01:53.337 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: route_target target:64512:8000003 10/21/2024 02:01:53.338 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000003 url = https://10.0.0.30:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000003"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000003"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.374 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2024-10-21T02:01:53.348832', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.348832', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10743432320907161717, 'uuid_mslong': 3883366252814877073}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '35e47d08-2fc5-4191-9518-56c6541f3075'}, 'oper': 'CREATE', 'request-id': 'req-578fc590-6df8-413d-9ca5-b428af5946e3', 'type': 'route_target', 'uuid': '35e47d08-2fc5-4191-9518-56c6541f3075'} 10/21/2024 02:01:53.378 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'check_multicast_template'] not found in DB: Unknown id: job_template default-global-system-config:check_multicast_template 10/21/2024 02:01:53.378 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:check_multicast_template 10/21/2024 02:01:53.385 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:check_multicast_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "check_multicast_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"warning_banner\": {\"$id\": \"/properties/warning_banner\", \"title\": \"This GDO gathers multicast statistics from the whole fabric and it might take a few minutes to complete.\", \"type\": \"object\", \"properties\": {\"warning_banner_2\": {\"$id\": \"/properties/warning_banner_2\", \"title\": \"It is assumed that:\", \"type\": \"object\", \"properties\": {\"warning_banner_3\": {\"$id\": \"/properties/warning_banner_3\", \"title\": \"(1) the traffic is coming from outside of the fabric (through device(s) with CRB-MCAST-Gateway role);\", \"type\": \"object\", \"properties\": {\"warning_banner_4\": {\"$id\": \"/properties/warning_banner_4\", \"title\": \"(2) the traffic is going to devices attached to server leaves (physical_router_role == 'leaf');\", \"type\": \"object\", \"properties\": {\"warning_banner_5\": {\"$id\": \"/properties/warning_banner_5\", \"title\": \"(3) PIM is enabled in the fabric.\", \"type\": \"object\", \"properties\": {}}}}}}}}}}, \"source\": {\"$id\": \"/properties/source\", \"title\": \"Source\", \"type\": \"string\", \"default\": \"\"}, \"group\": {\"$id\": \"/properties/group\", \"title\": \"Group\", \"type\": \"string\", \"default\": \"\"}}, \"required\": [\"source\", \"group\"]}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Check multicast output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Device Configuration\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "Check multicast", "display_name": "Check incoming multicast traffic", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.472 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04b5002c-41a0-4bf2-a878-358fac405bef object_type = routing_instance identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"type": "routing-instance", "uuid": "04b5002c-41a0-4bf2-a878-358fac405bef", "ref-type": "route-target", "ref-uuid": "35e47d08-2fc5-4191-9518-56c6541f3075", "ref-fq-name": ["target:64512:8000003"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.480 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'check_multicast_template'], 'obj_dict': {'display_name': 'Check incoming multicast traffic', 'fq_name': ['default-global-system-config', 'check_multicast_template'], 'id_perms': {'created': '2024-10-21T02:01:53.420244', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.420244', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11631447758060939280, 'uuid_mslong': 13132796592001010957}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'Check multicast', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"warning_banner": ' '{"$id": ' '"/properties/warning_banner", ' '"title": "This GDO gathers ' 'multicast statistics from the ' 'whole fabric and it might take a ' 'few minutes to complete.", "type": ' '"object", "properties": ' '{"warning_banner_2": {"$id": ' '"/properties/warning_banner_2", ' '"title": "It is assumed that:", ' '"type": "object", "properties": ' '{"warning_banner_3": {"$id": ' '"/properties/warning_banner_3", ' '"title": "(1) the traffic is ' 'coming from outside of the fabric ' '(through device(s) with ' 'CRB-MCAST-Gateway role);", "type": ' '"object", "properties": ' '{"warning_banner_4": {"$id": ' '"/properties/warning_banner_4", ' '"title": "(2) the traffic is going ' 'to devices attached to server ' 'leaves (physical_router_role == ' '\'leaf\');", "type": "object", ' '"properties": {"warning_banner_5": ' '{"$id": ' '"/properties/warning_banner_5", ' '"title": "(3) PIM is enabled in ' 'the fabric.", "type": "object", ' '"properties": {}}}}}}}}}}, ' '"source": {"$id": ' '"/properties/source", "title": ' '"Source", "type": "string", ' '"default": ""}, "group": {"$id": ' '"/properties/group", "title": ' '"Group", "type": "string", ' '"default": ""}}, "required": ' '["source", "group"]}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Check multicast ' 'output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Device ' 'Configuration", "description": ' '"Display Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b64110eb-7dae-4d0d-a16b-341c22bc6810'}, 'oper': 'CREATE', 'request-id': 'req-6c4f54f4-c3dc-4221-af32-db1ff491a697', 'type': 'job_template', 'uuid': 'b64110eb-7dae-4d0d-a16b-341c22bc6810'} 10/21/2024 02:01:53.502 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-2ca6f7c2-2d25-4759-a3df-7ab8c6e378c8', 'type': 'routing_instance', 'uuid': '04b5002c-41a0-4bf2-a878-358fac405bef'} 10/21/2024 02:01:53.585 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'existing_fabric_onboard_template'] not found in DB: Unknown id: job_template default-global-system-config:existing_fabric_onboard_template 10/21/2024 02:01:53.585 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:existing_fabric_onboard_template 10/21/2024 02:01:53.599 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:existing_fabric_onboard_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "existing_fabric_onboard_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/existing_fabric_onboard.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_device.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_role.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 10, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 5, "sequence_no": 3}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/device_import.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 40, "sequence_no": 4}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 5}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\", \"management_subnets\", \"device_auth\", \"node_profiles\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"fabric_display_name\": {\"type\": \"string\"}, \"fabric_cluster_id\": {\"type\": \"integer\"}, \"management_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"description\": \"List of the management network subnets for the fabric\", \"additionalProperties\": false, \"required\": [\"cidr\"], \"properties\": {\"cidr\": {\"type\": \"string\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}, \"gateway\": {\"type\": \"string\", \"format\": \"ipv4\"}}}}, \"loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"overlay_loopback_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that fabric device overlay loopback ips can be allocated.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"pnf_servicechain_subnets\": {\"type\": \"array\", \"items\": {\"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for service chaining between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"fabric_asn_pool\": {\"type\": \"array\", \"items\": {\"title\": \"eBGP ASN Pool for fabric underlay network\", \"type\": \"object\", \"description\": \"List of the ASN pools that could be used to configure the eBGP peers for the IP fabric\", \"properties\": {\"asn_min\": {\"type\": \"integer\"}, \"asn_max\": {\"type\": \"integer\"}}, \"required\": [\"asn_min\", \"asn_max\"]}}, \"overlay_ibgp_asn\": {\"type\": \"integer\", \"title\": \"iBGP ASN for Contrail overlay network\", \"default\": 64512}, \"device_auth\": {\"title\": \"Device Auth\", \"type\": \"array\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"required\": [\"username\", \"password\"], \"properties\": {\"username\": {\"type\": \"string\"}, \"password\": {\"type\": \"string\"}}}}, \"node_profiles\": {\"type\": \"array\", \"items\": {\"title\": \"Node profile\", \"type\": \"object\", \"description\": \"List of node profiles to be used by the fabric.\", \"additionalProperties\": false, \"properties\": {\"node_profile_name\": {\"type\": \"string\"}, \"serial_nums\": {\"type\": \"array\", \"description\": \"Optional list of serial numbers of fabric devices that we want to associate with this node profile.\", \"items\": {\"type\": \"string\"}}}, \"required\": [\"node_profile_name\"]}}, \"interface_filters\": {\"type\": \"array\", \"items\": {\"type\": \"object\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"]}, \"expr\": {\"type\": \"string\"}}, \"title\": \"filter object\", \"description\": \"filter object having op and expr fields\", \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}, \"manage_underlay\": {\"title\": \"Manage underlay networking\", \"type\": \"boolean\", \"description\": \"Set to true if need to configure underlay networking\", \"default\": false}, \"import_configured\": {\"type\": \"boolean\", \"default\": false, \"description\": \"Not importing configured interfaces by default. Set this option to true if configured interfaces need to be imported as part of onboarding.\"}, \"device_count\": {\"title\": \"Number of fabric devices\", \"type\": \"integer\", \"description\": \"Total number of devices in the fabric that needs to be zero-touch provisioned\"}, \"enterprise_style\": {\"type\": \"boolean\", \"default\": true, \"description\": \"True if enterprise style, false if sp-style configuration\"}, \"disable_vlan_vn_uniqueness_check\": {\"type\": \"boolean\", \"default\": false, \"description\": \"True if vlan-vn uniqueness validation checks needs to be disabled, false if enable all complex validations\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Existing Fabric Onboarding", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.629 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'] not found in DB: Unknown id: access_control_list default-domain:default-project:ip-fabric:ip-fabric 10/21/2024 02:01:53.629 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: access_control_list default-domain:default-project:ip-fabric:ip-fabric 10/21/2024 02:01:53.667 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.30:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "ip-fabric"], "parent_type": "virtual-network", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ip-fabric"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.688 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'obj_dict': {'display_name': 'Existing Fabric Onboarding', 'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'id_perms': {'created': '2024-10-21T02:01:53.613420', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.613420', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13326856910376910457, 'uuid_mslong': 15531346935075654328}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"management_subnets", ' '"device_auth", "node_profiles"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"fabric_display_name": {"type": ' '"string"}, "fabric_cluster_id": ' '{"type": "integer"}, ' '"management_subnets": {"type": ' '"array", "items": {"type": ' '"object", "description": "List of ' 'the management network subnets for ' 'the fabric", ' '"additionalProperties": false, ' '"required": ["cidr"], ' '"properties": {"cidr": {"type": ' '"string", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}, ' '"gateway": {"type": "string", ' '"format": "ipv4"}}}}, ' '"loopback_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that fabric ' 'device loopback ips can be ' 'allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"overlay_loopback_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'fabric device overlay loopback ips ' 'can be allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that could be ' 'carved out for the p2p networks ' 'between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"pnf_servicechain_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for service ' 'chaining between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_asn_pool": {"type": ' '"array", "items": {"title": "eBGP ' 'ASN Pool for fabric underlay ' 'network", "type": "object", ' '"description": "List of the ASN ' 'pools that could be used to ' 'configure the eBGP peers for the ' 'IP fabric", "properties": ' '{"asn_min": {"type": "integer"}, ' '"asn_max": {"type": "integer"}}, ' '"required": ["asn_min", ' '"asn_max"]}}, "overlay_ibgp_asn": ' '{"type": "integer", "title": "iBGP ' 'ASN for Contrail overlay network", ' '"default": 64512}, "device_auth": ' '{"title": "Device Auth", "type": ' '"array", "items": {"type": ' '"object", "additionalProperties": ' 'false, "required": ["username", ' '"password"], "properties": ' '{"username": {"type": "string"}, ' '"password": {"type": "string"}}}}, ' '"node_profiles": {"type": "array", ' '"items": {"title": "Node profile", ' '"type": "object", "description": ' '"List of node profiles to be used ' 'by the fabric.", ' '"additionalProperties": false, ' '"properties": ' '{"node_profile_name": {"type": ' '"string"}, "serial_nums": {"type": ' '"array", "description": "Optional ' 'list of serial numbers of fabric ' 'devices that we want to associate ' 'with this node profile.", "items": ' '{"type": "string"}}}, "required": ' '["node_profile_name"]}}, ' '"interface_filters": {"type": ' '"array", "items": {"type": ' '"object", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}, ' '"manage_underlay": {"title": ' '"Manage underlay networking", ' '"type": "boolean", "description": ' '"Set to true if need to configure ' 'underlay networking", "default": ' 'false}, "import_configured": ' '{"type": "boolean", "default": ' 'false, "description": "Not ' 'importing configured interfaces by ' 'default. Set this option to true ' 'if configured interfaces need to ' 'be imported as part of ' 'onboarding."}, "device_count": ' '{"title": "Number of fabric ' 'devices", "type": "integer", ' '"description": "Total number of ' 'devices in the fabric that needs ' 'to be zero-touch provisioned"}, ' '"enterprise_style": {"type": ' '"boolean", "default": true, ' '"description": "True if enterprise ' 'style, false if sp-style ' 'configuration"}, ' '"disable_vlan_vn_uniqueness_check": ' '{"type": "boolean", "default": ' 'false, "description": "True if ' 'vlan-vn uniqueness validation ' 'checks needs to be disabled, false ' 'if enable all complex ' 'validations"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/existing_fabric_onboard.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 40, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 4, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 5, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd78a6dbf-b489-4ab8-b8f2-81c05379be79'}, 'oper': 'CREATE', 'request-id': 'req-d9e2ee69-993a-4015-9917-9e25bf916043', 'type': 'job_template', 'uuid': 'd78a6dbf-b489-4ab8-b8f2-81c05379be79'} 10/21/2024 02:01:53.755 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:53.755 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:53.755 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:53.755 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:53.755 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:53.756 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:53.757 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:53.758 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:53.759 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:53.767 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:53.767 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:53.767 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:53.767 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:53.767 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:53.767 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:53.768 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:53.770 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:53.770 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:53.770 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:53.770 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:53.771 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:53.772 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:53.772 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:53.772 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:53.781 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:53.781 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:53.781 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:53.782 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:53.792 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2024-10-21T02:01:53.707395', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.707395', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11251658973732565571, 'uuid_mslong': 6204689610499637683}}, 'parent_type': 'virtual-network', 'parent_uuid': '1e338ece-fda8-4842-aa92-7ce58d0af31f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '561b7c53-af63-41b3-9c25-ec39072a7243'}, 'oper': 'CREATE', 'request-id': 'req-54a816ac-71eb-4c85-98e3-41d12f52f67f', 'type': 'access_control_list', 'uuid': '561b7c53-af63-41b3-9c25-ec39072a7243'} 10/21/2024 02:01:53.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:53.796 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'vcenter_import_template'] not found in DB: Unknown id: job_template default-global-system-config:vcenter_import_template 10/21/2024 02:01:53.797 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:vcenter_import_template 10/21/2024 02:01:53.802 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:vcenter_import_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "vcenter_import_template"], "parent_type": "global-system-config", "job_template_type": "executable", "job_template_concurrency_level": "fabric", "job_template_executables": {"executable_info": [{"executable_path": "/opt/contrail/utils/vcenter-import", "executable_args": "", "job_completion_weightage": 100}]}, "job_template_input_schema": "{\"title\": \"vCenter Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"contrail_command\": {\"$id\": \"/properties/contrail_command\", \"description\": \"The Contrail Command details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/contrail_command/username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/contrail_command/password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/contrail_command/host\", \"description\": \"The Contrail Command IP and/or port\", \"type\": \"string\"}}}, \"vcenter\": {\"$id\": \"/properties/vcenter\", \"description\": \"vCenter details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/vcenter/username\", \"description\": \"Username of vCenter Server\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/vcenter/password\", \"description\": \"Password of vCenter Server\", \"type\": \"string\"}, \"datacenter\": {\"$id\": \"/properties/vcenter/datacenter\", \"description\": \"vCenter DataCenter name to Import ESXi Hosts\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/vcenter/host\", \"description\": \"vCenter Hostname/IP-Address including port\", \"type\": \"string\"}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "VCenter Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.819 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3399ecd8-cc43-4d0f-b3df-7d2f1ca31df4 object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:ingress-access-control-list url = https://10.0.0.30:8082/access-control-list/3399ecd8-cc43-4d0f-b3df-7d2f1ca31df4 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": "3399ecd8-cc43-4d0f-b3df-7d2f1ca31df4", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.894 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'obj_dict': {'display_name': 'VCenter Import', 'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'id_perms': {'created': '2024-10-21T02:01:53.823138', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.823138', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13630314415311268420, 'uuid_mslong': 13437088174683671096}}, 'job_template_concurrency_level': 'fabric', 'job_template_executables': {'executable_info': [{'executable_args': '', 'executable_path': '/opt/contrail/utils/vcenter-import', 'job_completion_weightage': 100}]}, 'job_template_input_schema': '{"title": "vCenter Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"contrail_command": {"$id": ' '"/properties/contrail_command", ' '"description": "The Contrail ' 'Command details", "type": ' '"object", "properties": ' '{"username": {"$id": ' '"/properties/contrail_command/username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "password": {"$id": ' '"/properties/contrail_command/password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, "host": {"$id": ' '"/properties/contrail_command/host", ' '"description": "The Contrail ' 'Command IP and/or port", "type": ' '"string"}}}, "vcenter": {"$id": ' '"/properties/vcenter", ' '"description": "vCenter details", ' '"type": "object", "properties": ' '{"username": {"$id": ' '"/properties/vcenter/username", ' '"description": "Username of ' 'vCenter Server", "type": ' '"string"}, "password": {"$id": ' '"/properties/vcenter/password", ' '"description": "Password of ' 'vCenter Server", "type": ' '"string"}, "datacenter": {"$id": ' '"/properties/vcenter/datacenter", ' '"description": "vCenter DataCenter ' 'name to Import ESXi Hosts", ' '"type": "string"}, "host": {"$id": ' '"/properties/vcenter/host", ' '"description": "vCenter ' 'Hostname/IP-Address including ' 'port", "type": "string"}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_type': 'executable', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ba7a2080-8b9f-4a38-bd28-9abe8583aa44'}, 'oper': 'CREATE', 'request-id': 'req-2a4c9486-4711-4d8c-b974-9c701ebe645e', 'type': 'job_template', 'uuid': 'ba7a2080-8b9f-4a38-bd28-9abe8583aa44'} 10/21/2024 02:01:53.899 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-e3c38780-4a8f-41dc-9ae9-83d48583c129', 'type': 'access_control_list', 'uuid': '3399ecd8-cc43-4d0f-b3df-7d2f1ca31df4'} 10/21/2024 02:01:53.902 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: analytics_alarm_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:53.902 7fcafef4b240 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: analytics_alarm_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:53.913 7fcafef4b240 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.30 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.933 7fcaff1022e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7cd846ea-3c3a-49ce-aa6a-2d38f04925a1 object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = https://10.0.0.30:8082/access-control-list/7cd846ea-3c3a-49ce-aa6a-2d38f04925a1 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": "7cd846ea-3c3a-49ce-aa6a-2d38f04925a1", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:53.953 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:53.936724', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:53.936724', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9464180107803434253, 'uuid_mslong': 3903059455896799277}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '362a73e5-55f5-482d-8357-85aa27f11d0d'}, 'oper': 'CREATE', 'request-id': 'req-032aac05-c78c-4328-804a-410d3f22c8dc', 'type': 'analytics_alarm_node', 'uuid': '362a73e5-55f5-482d-8357-85aa27f11d0d'} 10/21/2024 02:01:53.953 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 10/21/2024 02:01:53.954 7fcafefff048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:53.954 7fcafefff048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { analytics_alarm_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3903059455896799277, "uuid_lslong": 9464180107803434253}, "enable": true, "created": "2024-10-21T02:01:53.936724", "last_modified": "2024-10-21T02:01:53.936724", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "362a73e5-55f5-482d-8357-85aa27f11d0d" } deleted = False >> 10/21/2024 02:01:53.954 7fcafefff048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:53.963 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-ab60f353-b596-4a19-96db-6f35d3fb5678', 'type': 'access_control_list', 'uuid': '7cd846ea-3c3a-49ce-aa6a-2d38f04925a1'} 10/21/2024 02:01:53.973 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'discover_server_template'] not found in DB: Unknown id: job_template default-global-system-config:discover_server_template 10/21/2024 02:01:53.973 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:discover_server_template 10/21/2024 02:01:53.980 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:discover_server_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "discover_server_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/discover_server.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"ipmi\": {\"$id\": \"/properties/ipmi\", \"type\": \"object\", \"required\": [\"ipmi_subnet_list\", \"ipmi_credentials\"], \"properties\": {\"ipmi_subnet_list\": {\"$id\": \"/properties/ipmi/properties/ipmi_subnet_list\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_subnet_list/items\", \"type\": \"string\", \"description\": \"List of the subnet prefixes that could be carved out for the p2p networks between fabric devices.\", \"pattern\": \"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$\"}}, \"ipmi_credentials\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials/items\", \"description\": \"The IPMI user:password credentials\", \"type\": \"string\"}}, \"ipmi_port_ranges\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/ipmi/properties/ipmi_credentials/items\", \"type\": \"object\", \"required\": [\"port_range_start\", \"port_range_end\"], \"properties\": {\"port_range_start\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start\", \"description\": \"Start of IPMI Port Range\", \"type\": \"integer\"}, \"port_range_end\": {\"$id\": \"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end\", \"description\": \"End of IPMI Port Range\", \"type\": \"integer\"}}}}}}, \"ironic\": {\"$id\": \"/properties/ironic\", \"type\": \"object\", \"required\": [\"auth_url\", \"username\", \"password\"], \"properties\": {\"auth_url\": {\"$id\": \"/properties/ironic/properties/auth_url\", \"description\": \"The Ironic Auth URL\", \"type\": \"string\"}, \"username\": {\"$id\": \"/properties/ironic/properties/username\", \"description\": \"The Ironic Auth username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/ironic/properties/password\", \"description\": \"The Ironic Auth password\", \"type\": \"string\"}, \"introspection_flag\": {\"$id\": \"/properties/ironic/properties/introspection_flag\", \"description\": \"Flag to determine if introspection is needed\", \"type\": \"boolean\", \"default\": true}}}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Discovery", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:54.065 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:54.065 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:54.065 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:54.066 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:54.068 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:54.069 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:54.069 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:54.069 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:54.069 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:54.069 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:54.070 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:54.071 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:54.071 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:54.071 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:54.071 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:54.071 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:54.071 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:54.072 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:54.073 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:54.073 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:54.073 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:54.073 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:54.074 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:54.074 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:54.074 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:54.074 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:54.075 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:54.076 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:54.076 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:54.076 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:54.076 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:54.076 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:54.076 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:54.077 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:54.077 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:54.077 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:54.078 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:54.078 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:54.078 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:54.078 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:54.078 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:54.079 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:54.079 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:54.079 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:54.079 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:54.079 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:54.079 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:54.088 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'discover_server_template'], 'obj_dict': {'display_name': 'Server Discovery', 'fq_name': ['default-global-system-config', 'discover_server_template'], 'id_perms': {'created': '2024-10-21T02:01:54.001175', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.001175', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10735943990379744907, 'uuid_mslong': 7756784541567370147}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "ipmi": ' '{"$id": "/properties/ipmi", ' '"type": "object", "required": ' '["ipmi_subnet_list", ' '"ipmi_credentials"], "properties": ' '{"ipmi_subnet_list": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list/items", ' '"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for the p2p ' 'networks between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"ipmi_credentials": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"description": "The IPMI ' 'user:password credentials", ' '"type": "string"}}, ' '"ipmi_port_ranges": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"type": "object", "required": ' '["port_range_start", ' '"port_range_end"], "properties": ' '{"port_range_start": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start", ' '"description": "Start of IPMI Port ' 'Range", "type": "integer"}, ' '"port_range_end": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end", ' '"description": "End of IPMI Port ' 'Range", "type": "integer"}}}}}}, ' '"ironic": {"$id": ' '"/properties/ironic", "type": ' '"object", "required": ["auth_url", ' '"username", "password"], ' '"properties": {"auth_url": {"$id": ' '"/properties/ironic/properties/auth_url", ' '"description": "The Ironic Auth ' 'URL", "type": "string"}, ' '"username": {"$id": ' '"/properties/ironic/properties/username", ' '"description": "The Ironic Auth ' 'username", "type": "string"}, ' '"password": {"$id": ' '"/properties/ironic/properties/password", ' '"description": "The Ironic Auth ' 'password", "type": "string"}, ' '"introspection_flag": {"$id": ' '"/properties/ironic/properties/introspection_flag", ' '"description": "Flag to determine ' 'if introspection is needed", ' '"type": "boolean", "default": ' 'true}}}, "cc_username": {"$id": ' '"/properties/cc_username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_server.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6ba5a271-7f5d-43a3-94fd-bc2d83130e8b'}, 'oper': 'CREATE', 'request-id': 'req-ad0fe4ff-e9f3-44a6-9962-491854ed697e', 'type': 'job_template', 'uuid': '6ba5a271-7f5d-43a3-94fd-bc2d83130e8b'} 10/21/2024 02:01:54.166 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'server_import_template'] not found in DB: Unknown id: job_template default-global-system-config:server_import_template 10/21/2024 02:01:54.166 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:server_import_template 10/21/2024 02:01:54.174 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:server_import_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "server_import_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/server_import.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"server import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Server Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:54.186 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: database_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:54.187 7fcafeee2828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: database_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:54.195 7fcafeee2828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.30 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:54.257 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'server_import_template'], 'obj_dict': {'display_name': 'Server Import', 'fq_name': ['default-global-system-config', 'server_import_template'], 'id_perms': {'created': '2024-10-21T02:01:54.201332', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.201332', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9521908188998793985, 'uuid_mslong': 12633742091049716760}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command IP", "type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/server_import.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'af54117e-d0eb-4c18-8424-9d0c7527fb01'}, 'oper': 'CREATE', 'request-id': 'req-08c0e3fa-5453-4c79-8abf-e7761b8c37a8', 'type': 'job_template', 'uuid': 'af54117e-d0eb-4c18-8424-9d0c7527fb01'} 10/21/2024 02:01:54.269 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'database_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:54.254053', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.254053', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12502588593934184557, 'uuid_mslong': 7116055864018814876}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '62c14f1b-18ad-479c-ad82-1e15aa4c306d'}, 'oper': 'CREATE', 'request-id': 'req-2f5fd100-c0e5-4c6a-9df2-7c5a49b5b1fa', 'type': 'database_node', 'uuid': '62c14f1b-18ad-479c-ad82-1e15aa4c306d'} 10/21/2024 02:01:54.270 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 10/21/2024 02:01:54.271 7fcafef08f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:54.271 7fcafef08f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { database_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7116055864018814876, "uuid_lslong": 12502588593934184557}, "enable": true, "created": "2024-10-21T02:01:54.254053", "last_modified": "2024-10-21T02:01:54.254053", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "62c14f1b-18ad-479c-ad82-1e15aa4c306d" } deleted = False >> 10/21/2024 02:01:54.271 7fcafef08f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:54.359 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'node_profile_template'] not found in DB: Unknown id: job_template default-global-system-config:node_profile_template 10/21/2024 02:01:54.360 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:node_profile_template 10/21/2024 02:01:54.366 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:node_profile_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "node_profile_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/node_profile.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Node Profile Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command Hostname/IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Node Profile", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:54.456 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'obj_dict': {'display_name': 'Node Profile', 'fq_name': ['default-global-system-config', 'node_profile_template'], 'id_perms': {'created': '2024-10-21T02:01:54.399165', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.399165', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9905467577092047793, 'uuid_mslong': 6055207205214571033}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Node Profile Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command Hostname/IP", "type": ' '"string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/node_profile.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '54086adf-0c33-4a19-8977-4a47aab883b1'}, 'oper': 'CREATE', 'request-id': 'req-8d0d7e35-8407-49fc-a164-2f733cd96b54', 'type': 'job_template', 'uuid': '54086adf-0c33-4a19-8977-4a47aab883b1'} 10/21/2024 02:01:54.548 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_mac_mob_template'] not found in DB: Unknown id: job_template default-global-system-config:show_mac_mob_template 10/21/2024 02:01:54.549 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:show_mac_mob_template 10/21/2024 02:01:54.554 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_mac_mob_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_mac_mob_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"mac_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"MAC Details\", \"type\": \"object\", \"properties\": {\"mac_address\": {\"$id\": \"/properties/mac_address\", \"title\": \"Mac Address\", \"pattern\": \"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$\", \"type\": \"string\"}}, \"required\": [\"mac_address\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show MAC mobility Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"MAC History\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "{\"mac_details\": {\"mac_address\": {\"ui:help\": \"Enter a 48 bit MAC address in colon separated format; for example, 00:00:0A:BB:28:FC\", \"ui:placeholder\": \"Enter MAC address\"}}}", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display MAC address move or mobility", "display_name": "Show mac mobility", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:54.630 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'obj_dict': {'display_name': 'Show mac mobility', 'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'id_perms': {'created': '2024-10-21T02:01:54.571200', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.571200', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12982892941131447786, 'uuid_mslong': 15384476113807625322}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display MAC ' 'address move or mobility', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"mac_details": ' '{"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "MAC Details", "type": ' '"object", "properties": ' '{"mac_address": {"$id": ' '"/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}, "required": ' '["mac_address"]}}}', 'job_template_input_ui_schema': '{"mac_details": {"mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show MAC mobility ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "MAC History", ' '"description": "Display Device ' 'Configuration output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd580a383-dafc-4c6a-b42c-8057f910fdea'}, 'oper': 'CREATE', 'request-id': 'req-a03ec42a-d208-46ef-8c76-577f076f9a8e', 'type': 'job_template', 'uuid': 'd580a383-dafc-4c6a-b42c-8057f910fdea'} 10/21/2024 02:01:54.725 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rma_activate_template'] not found in DB: Unknown id: job_template default-global-system-config:rma_activate_template 10/21/2024 02:01:54.725 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:rma_activate_template 10/21/2024 02:01:54.730 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:rma_activate_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "rma_activate_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/rma_activate.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 0}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 15, "sequence_no": 1}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 50, "sequence_no": 2}, {"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 20, "sequence_no": 3}]}, "job_template_recovery_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": null, "device_family": null, "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"RMA activate\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_uuid\": {\"type\": \"string\", \"description\": \"Fabric UUID\"}, \"rma_devices\": {\"type\": \"array\", \"items\": {\"title\": \"RMA Devices\", \"type\": \"object\", \"description\": \"List of devices and corresponding serial numbers to RMA\", \"additionalProperties\": false, \"properties\": {\"device_uuid\": {\"type\": \"string\", \"format\": \"uuid\"}, \"serial_number\": {\"type\": \"string\"}}, \"required\": [\"device_uuid\", \"serial_number\"]}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "RMA Activation", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:54.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:54.808 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'obj_dict': {'display_name': 'RMA Activation', 'fq_name': ['default-global-system-config', 'rma_activate_template'], 'id_perms': {'created': '2024-10-21T02:01:54.740411', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.740411', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9515827709494816197, 'uuid_mslong': 15764828356246260530}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "RMA activate", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "rma_devices": ' '{"type": "array", "items": ' '{"title": "RMA Devices", "type": ' '"object", "description": "List of ' 'devices and corresponding serial ' 'numbers to RMA", ' '"additionalProperties": false, ' '"properties": {"device_uuid": ' '{"type": "string", "format": ' '"uuid"}, "serial_number": {"type": ' '"string"}}, "required": ' '["device_uuid", ' '"serial_number"]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/rma_activate.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dac7ebdd-4710-4b32-840f-02e28041edc5'}, 'oper': 'CREATE', 'request-id': 'req-ad8e8afa-9125-441d-a7f5-61197a36061d', 'type': 'job_template', 'uuid': 'dac7ebdd-4710-4b32-840f-02e28041edc5'} 10/21/2024 02:01:54.896 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'show_chassis_info_template'] not found in DB: Unknown id: job_template default-global-system-config:show_chassis_info_template 10/21/2024 02:01:54.897 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:show_chassis_info_template 10/21/2024 02:01:54.903 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_chassis_info_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_chassis_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"chassis\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Chassis information\", \"type\": \"object\", \"properties\": {\"chassis_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis hardware\"}}, \"required\": [\"chassis_detail\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display chassis information", "display_name": "Show chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.008 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'obj_dict': {'display_name': 'Show chassis information', 'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'id_perms': {'created': '2024-10-21T02:01:54.949228', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:54.949228', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13256354088473966756, 'uuid_mslong': 15247190854822545930}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'chassis information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"chassis": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Chassis information", ' '"type": "object", "properties": ' '{"chassis_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis hardware"}}, ' '"required": ["chassis_detail"]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd398e74c-a448-4a0a-b7f8-07ceec49b8a4'}, 'oper': 'CREATE', 'request-id': 'req-bcd07f3b-fc57-4bea-871d-0cd45be164cc', 'type': 'job_template', 'uuid': 'd398e74c-a448-4a0a-b7f8-07ceec49b8a4'} 10/21/2024 02:01:55.100 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'hardware_inventory_template'] not found in DB: Unknown id: job_template default-global-system-config:hardware_inventory_template 10/21/2024 02:01:55.101 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: job_template default-global-system-config:hardware_inventory_template 10/21/2024 02:01:55.106 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:hardware_inventory_template url = https://10.0.0.30:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "hardware_inventory_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Hardware Inventory Information\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"minProperties\": 1}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to fetch hardware inventory information from the device", "display_name": "Fetch hardware chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.169 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'obj_dict': {'display_name': 'Fetch hardware chassis information', 'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'id_perms': {'created': '2024-10-21T02:01:55.118131', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.118131', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12229584085802058086, 'uuid_mslong': 1118400524925093142}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to fetch ' 'hardware inventory information from ' 'the device', 'job_template_input_schema': '{"title": "Hardware Inventory ' 'Information", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", "minProperties": ' '1}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0f855b5a-14c5-4516-a9b8-35ee51008166'}, 'oper': 'CREATE', 'request-id': 'req-60994cc3-a492-4a99-8feb-18b5bc79b0f8', 'type': 'job_template', 'uuid': '0f855b5a-14c5-4516-a9b8-35ee51008166'} 10/21/2024 02:01:55.270 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'config_property'] not found in DB: Unknown id: config_properties default-global-system-config:config_property 10/21/2024 02:01:55.271 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: config_properties default-global-system-config:config_property 10/21/2024 02:01:55.277 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_properties identifier_name = default-global-system-config:config_property url = https://10.0.0.30:8082/config-propertiess operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"config-properties": {"uuid": null, "fq_name": ["default-global-system-config", "config_property"], "parent_type": "global-system-config", "properties": {"key_value_pair": [{"key": "junos_commit_timeout", "value": "600"}, {"key": "total_retry_timeout", "value": "600"}, {"key": "device_command_timeout", "value": "600"}, {"key": "ztp_timeout", "value": "570"}]}, "display_name": "Config Property", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.309 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'obj_dict': {'display_name': 'Config Property', 'fq_name': ['default-global-system-config', 'config_property'], 'id_perms': {'created': '2024-10-21T02:01:55.296304', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.296304', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12650382346811845715, 'uuid_mslong': 15799926958463731640}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'properties': {'key_value_pair': [{'key': 'junos_commit_timeout', 'value': '600'}, {'key': 'total_retry_timeout', 'value': '600'}, {'key': 'device_command_timeout', 'value': '600'}, {'key': 'ztp_timeout', 'value': '570'}]}, 'uuid': 'db449ddb-6c59-47b8-af8f-2fb84697ac53'}, 'oper': 'CREATE', 'request-id': 'req-b565dd10-cb81-47af-9ca5-cd2957a8471e', 'type': 'config_properties', 'uuid': 'db449ddb-6c59-47b8-af8f-2fb84697ac53'} 10/21/2024 02:01:55.364 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-management-ip'] not found in DB: Unknown id: tag label=fabric-management-ip 10/21/2024 02:01:55.364 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-management-ip 10/21/2024 02:01:55.365 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-management-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-management-ip"], "tag_type_name": "label", "tag_value": "fabric-management-ip", "tag_predefined": true, "name": "label=fabric-management-ip", "display_name": "label=fabric-management-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.415 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-management-ip'], 'obj_dict': {'display_name': 'label=fabric-management-ip', 'fq_name': ['label=fabric-management-ip'], 'id_perms': {'created': '2024-10-21T02:01:55.399764', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.399764', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13219897622821484026, 'uuid_mslong': 9078647937797606343}}, 'name': 'label=fabric-management-ip', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000000', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-management-ip', 'uuid': '7dfdd632-dd42-4bc7-b776-82d88f4e35fa'}, 'oper': 'CREATE', 'request-id': 'req-4664e955-4cf8-4bc7-9017-292190af82d0', 'type': 'tag', 'uuid': '7dfdd632-dd42-4bc7-b776-82d88f4e35fa'} 10/21/2024 02:01:55.416 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:55.417 7fcafee9f390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:55.417 7fcafee9f390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-management-ip elements = { display_name : "label=fabric-management-ip"fq_name : ["label=fabric-management-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9078647937797606343, "uuid_lslong": 13219897622821484026}, "enable": true, "created": "2024-10-21T02:01:55.399764", "last_modified": "2024-10-21T02:01:55.399764", "description": null, "user_visible": true, "creator": null}name : "label=fabric-management-ip"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000000"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-management-ip"uuid : "7dfdd632-dd42-4bc7-b776-82d88f4e35fa" } deleted = False >> 10/21/2024 02:01:55.417 7fcafee9f390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:55.512 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-loopback-ip'] not found in DB: Unknown id: tag label=fabric-loopback-ip 10/21/2024 02:01:55.513 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-loopback-ip 10/21/2024 02:01:55.513 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-loopback-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-loopback-ip", "tag_predefined": true, "name": "label=fabric-loopback-ip", "display_name": "label=fabric-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.541 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-loopback-ip', 'fq_name': ['label=fabric-loopback-ip'], 'id_perms': {'created': '2024-10-21T02:01:55.529696', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.529696', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11914947060296318434, 'uuid_mslong': 4750105990001345075}}, 'name': 'label=fabric-loopback-ip', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000001', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-loopback-ip', 'uuid': '41ebc43b-137c-4233-a55a-6539268bfde2'}, 'oper': 'CREATE', 'request-id': 'req-925776cc-9977-4010-9f34-99fb15c506f8', 'type': 'tag', 'uuid': '41ebc43b-137c-4233-a55a-6539268bfde2'} 10/21/2024 02:01:55.542 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:55.542 7fcafefff4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:55.543 7fcafefff4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-loopback-ip elements = { display_name : "label=fabric-loopback-ip"fq_name : ["label=fabric-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4750105990001345075, "uuid_lslong": 11914947060296318434}, "enable": true, "created": "2024-10-21T02:01:55.529696", "last_modified": "2024-10-21T02:01:55.529696", "description": null, "user_visible": true, "creator": null}name : "label=fabric-loopback-ip"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000001"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-loopback-ip"uuid : "41ebc43b-137c-4233-a55a-6539268bfde2" } deleted = False >> 10/21/2024 02:01:55.543 7fcafefff4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:55.636 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-overlay-loopback-ip'] not found in DB: Unknown id: tag label=fabric-overlay-loopback-ip 10/21/2024 02:01:55.636 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-overlay-loopback-ip 10/21/2024 02:01:55.637 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-overlay-loopback-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-overlay-loopback-ip"], "tag_type_name": "label", "tag_value": "fabric-overlay-loopback-ip", "tag_predefined": true, "name": "label=fabric-overlay-loopback-ip", "display_name": "label=fabric-overlay-loopback-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.669 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-overlay-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-overlay-loopback-ip', 'fq_name': ['label=fabric-overlay-loopback-ip'], 'id_perms': {'created': '2024-10-21T02:01:55.653404', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.653404', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12749959554276768708, 'uuid_mslong': 6115758512650078618}}, 'name': 'label=fabric-overlay-loopback-ip', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000002', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-overlay-loopback-ip', 'uuid': '54df89f6-ee94-499a-b0f0-f4a99543bbc4'}, 'oper': 'CREATE', 'request-id': 'req-2090d5b6-5d79-48e9-973d-c8fe3334e4cd', 'type': 'tag', 'uuid': '54df89f6-ee94-499a-b0f0-f4a99543bbc4'} 10/21/2024 02:01:55.670 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:55.671 7fcafef7d438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:55.671 7fcafef7d438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-overlay-loopback-ip elements = { display_name : "label=fabric-overlay-loopback-ip"fq_name : ["label=fabric-overlay-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 6115758512650078618, "uuid_lslong": 12749959554276768708}, "enable": true, "created": "2024-10-21T02:01:55.653404", "last_modified": "2024-10-21T02:01:55.653404", "description": null, "user_visible": true, "creator": null}name : "label=fabric-overlay-loopback-ip"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000002"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-overlay-loopback-ip"uuid : "54df89f6-ee94-499a-b0f0-f4a99543bbc4" } deleted = False >> 10/21/2024 02:01:55.671 7fcafef7d438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:01:55.756 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:01:55.764 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-peer-ip'] not found in DB: Unknown id: tag label=fabric-peer-ip 10/21/2024 02:01:55.764 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-peer-ip 10/21/2024 02:01:55.765 7fcaff1aac18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-peer-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-peer-ip"], "tag_type_name": "label", "tag_value": "fabric-peer-ip", "tag_predefined": true, "name": "label=fabric-peer-ip", "display_name": "label=fabric-peer-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.766 7fcaff1aac18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-peer-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-peer-ip"], "tag_type_name": "label", "tag_value": "fabric-peer-ip", "tag_predefined": true, "name": "label=fabric-peer-ip", "display_name": "label=fabric-peer-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:55.828 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-peer-ip'], 'obj_dict': {'display_name': 'label=fabric-peer-ip', 'fq_name': ['label=fabric-peer-ip'], 'id_perms': {'created': '2024-10-21T02:01:55.801501', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.801501', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9445540297513100434, 'uuid_mslong': 18120055829450146548}}, 'name': 'label=fabric-peer-ip', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000003', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-peer-ip', 'uuid': 'fb775ec5-d09f-42f4-8315-4cdb20e7e492'}, 'oper': 'CREATE', 'request-id': 'req-38095a8f-c12c-41c8-81eb-1cda505879df', 'type': 'tag', 'uuid': 'fb775ec5-d09f-42f4-8315-4cdb20e7e492'} 10/21/2024 02:01:55.828 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:55.918 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:55.918 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:55.919 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:55.919 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:55.919 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:55.919 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:55.920 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:55.921 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:55.922 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:55.923 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:55.924 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:55.926 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:55.927 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:55.928 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:55.929 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:55.929 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:55.929 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:55.934 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-pnf-servicechain-ip'] not found in DB: Unknown id: tag label=fabric-pnf-servicechain-ip 10/21/2024 02:01:55.935 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-pnf-servicechain-ip 10/21/2024 02:01:55.936 7fcaff0ac828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-pnf-servicechain-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-pnf-servicechain-ip"], "tag_type_name": "label", "tag_value": "fabric-pnf-servicechain-ip", "tag_predefined": true, "name": "label=fabric-pnf-servicechain-ip", "display_name": "label=fabric-pnf-servicechain-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:55.937 7fcaff0ac828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-pnf-servicechain-ip url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-pnf-servicechain-ip"], "tag_type_name": "label", "tag_value": "fabric-pnf-servicechain-ip", "tag_predefined": true, "name": "label=fabric-pnf-servicechain-ip", "display_name": "label=fabric-pnf-servicechain-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.008 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-pnf-servicechain-ip'], 'obj_dict': {'display_name': 'label=fabric-pnf-servicechain-ip', 'fq_name': ['label=fabric-pnf-servicechain-ip'], 'id_perms': {'created': '2024-10-21T02:01:55.980781', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:55.980781', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12967041880189221549, 'uuid_mslong': 10170090969341184405}}, 'name': 'label=fabric-pnf-servicechain-ip', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000004', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-pnf-servicechain-ip', 'uuid': '8d236bda-68fd-4995-b3f4-2fe3404abaad'}, 'oper': 'CREATE', 'request-id': 'req-be8a1a2b-9c6d-4f55-832f-7f6566b37e5e', 'type': 'tag', 'uuid': '8d236bda-68fd-4995-b3f4-2fe3404abaad'} 10/21/2024 02:01:56.017 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:56.035 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: analytics_snmp_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:56.036 7fcafee9f390 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: analytics_snmp_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:56.044 7fcafeea7d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.044 7fcafeea7d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.30 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.072 7fcafef5d6d8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:01:56.075 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:56.055536', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.055536', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10102809568385547253, 'uuid_mslong': 4922115650391591173}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '444ede1b-04fb-4905-8c34-63c68509bbf5'}, 'oper': 'CREATE', 'request-id': 'req-a8f585bb-bcba-462b-a527-4133c17ca83e', 'type': 'analytics_snmp_node', 'uuid': '444ede1b-04fb-4905-8c34-63c68509bbf5'} 10/21/2024 02:01:56.076 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 10/21/2024 02:01:56.101 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-as-number'] not found in DB: Unknown id: tag label=fabric-as-number 10/21/2024 02:01:56.102 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-as-number 10/21/2024 02:01:56.103 7fcafeeaa780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-as-number url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-as-number"], "tag_type_name": "label", "tag_value": "fabric-as-number", "tag_predefined": true, "name": "label=fabric-as-number", "display_name": "label=fabric-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.103 7fcafeeaa780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-as-number url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-as-number"], "tag_type_name": "label", "tag_value": "fabric-as-number", "tag_predefined": true, "name": "label=fabric-as-number", "display_name": "label=fabric-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.126 7fcafef74630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:01:56.148 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-as-number'], 'obj_dict': {'display_name': 'label=fabric-as-number', 'fq_name': ['label=fabric-as-number'], 'id_perms': {'created': '2024-10-21T02:01:56.133312', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.133312', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13715819447873007730, 'uuid_mslong': 10856301520373761942}}, 'name': 'label=fabric-as-number', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000005', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-as-number', 'uuid': '96a954b6-b069-4796-be58-611e49dd7072'}, 'oper': 'CREATE', 'request-id': 'req-0370d86d-b6d8-48f3-8214-5b3b51e77065', 'type': 'tag', 'uuid': '96a954b6-b069-4796-be58-611e49dd7072'} 10/21/2024 02:01:56.148 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:56.240 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['label=fabric-ebgp-as-number'] not found in DB: Unknown id: tag label=fabric-ebgp-as-number 10/21/2024 02:01:56.240 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: tag label=fabric-ebgp-as-number 10/21/2024 02:01:56.241 7fcaff1aac18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-ebgp-as-number url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-ebgp-as-number"], "tag_type_name": "label", "tag_value": "fabric-ebgp-as-number", "tag_predefined": true, "name": "label=fabric-ebgp-as-number", "display_name": "label=fabric-ebgp-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.241 7fcaff1aac18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-ebgp-as-number url = https://10.0.0.30:8082/tags operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-ebgp-as-number"], "tag_type_name": "label", "tag_value": "fabric-ebgp-as-number", "tag_predefined": true, "name": "label=fabric-ebgp-as-number", "display_name": "label=fabric-ebgp-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.287 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['label=fabric-ebgp-as-number'], 'obj_dict': {'display_name': 'label=fabric-ebgp-as-number', 'fq_name': ['label=fabric-ebgp-as-number'], 'id_perms': {'created': '2024-10-21T02:01:56.256351', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.256351', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13269267870521330949, 'uuid_mslong': 3064774810826262391}}, 'name': 'label=fabric-ebgp-as-number', 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000006', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': '9f878138-10fd-450a-8367-eda5f19e7cc9'}], 'tag_value': 'fabric-ebgp-as-number', 'uuid': '2a884473-dbdd-4777-b825-e8d31bed8d05'}, 'oper': 'CREATE', 'request-id': 'req-b938d353-030c-4ad0-99dd-9d03630dd389', 'type': 'tag', 'uuid': '2a884473-dbdd-4777-b825-e8d31bed8d05'} 10/21/2024 02:01:56.288 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 10/21/2024 02:01:56.390 7fcaff01ed68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/global-system-config/953d4841-c203-4a7e-b905-387930676988 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "953d4841-c203-4a7e-b905-387930676988", "fq_name": ["default-global-system-config"], "supported_device_families": {"device_family": ["junos", "junos-qfx"]}, "supported_vendor_hardwares": {"vendor_hardware": ["juniper-qfx10002-72q", "juniper-qfx10002-36q", "juniper-qfx10002-60c", "juniper-qfx10016", "juniper-qfx10008", "juniper-vqfx-10000", "juniper-qfx5100-48sh-afi", "juniper-qfx5100-48sh-afo", "juniper-qfx5100-48th-afi", "juniper-qfx5100-48th-afo", "juniper-qfx5100-48s-6q", "juniper-qfx5100-96s-8q", "juniper-qfx5100-48t", "juniper-qfx5100-48t-6q", "juniper-qfx5100-24q-2p", "juniper-qfx5100-24q-aa", "juniper-qfx5100e-48s-6q", "juniper-qfx5100e-96s-8q", "juniper-qfx5100e-48t-6q", "juniper-qfx5100e-24q-2p", "juniper-qfx5110-48s-4c", "juniper-qfx5110-32q", "juniper-qfx5120-48y-8c", "juniper-qfx5120-48t-6c", "juniper-qfx5120-32c", "juniper-qfx5220-32cd", "juniper-qfx5220-128c", "juniper-qfx5200-32c-32q", "juniper-qfx5200-48y", "juniper-qfx5210-64c", "juniper-vmx", "juniper-mx80", "juniper-mx80-48t", "juniper-mx204", "juniper-mx240", "juniper-mx480", "juniper-mx960", "juniper-mx2008", "juniper-mx2010", "juniper-mx2020", "juniper-mx10003", "juniper-jnp10008", "juniper-jnp10016", "juniper-srx5400", "juniper-srx5600", "juniper-srx4600", "juniper-srx4100", "juniper-srx1500", "juniper-srx240h-poe", "juniper-vsrx", "juniper-srx5800", "juniper-srx4200"]}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.390 7fcaff01ed68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/global-system-config/953d4841-c203-4a7e-b905-387930676988 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "953d4841-c203-4a7e-b905-387930676988", "fq_name": ["default-global-system-config"], "supported_device_families": {"device_family": ["junos", "junos-qfx"]}, "supported_vendor_hardwares": {"vendor_hardware": ["juniper-qfx10002-72q", "juniper-qfx10002-36q", "juniper-qfx10002-60c", "juniper-qfx10016", "juniper-qfx10008", "juniper-vqfx-10000", "juniper-qfx5100-48sh-afi", "juniper-qfx5100-48sh-afo", "juniper-qfx5100-48th-afi", "juniper-qfx5100-48th-afo", "juniper-qfx5100-48s-6q", "juniper-qfx5100-96s-8q", "juniper-qfx5100-48t", "juniper-qfx5100-48t-6q", "juniper-qfx5100-24q-2p", "juniper-qfx5100-24q-aa", "juniper-qfx5100e-48s-6q", "juniper-qfx5100e-96s-8q", "juniper-qfx5100e-48t-6q", "juniper-qfx5100e-24q-2p", "juniper-qfx5110-48s-4c", "juniper-qfx5110-32q", "juniper-qfx5120-48y-8c", "juniper-qfx5120-48t-6c", "juniper-qfx5120-32c", "juniper-qfx5220-32cd", "juniper-qfx5220-128c", "juniper-qfx5200-32c-32q", "juniper-qfx5200-48y", "juniper-qfx5210-64c", "juniper-vmx", "juniper-mx80", "juniper-mx80-48t", "juniper-mx204", "juniper-mx240", "juniper-mx480", "juniper-mx960", "juniper-mx2008", "juniper-mx2010", "juniper-mx2020", "juniper-mx10003", "juniper-jnp10008", "juniper-jnp10016", "juniper-srx5400", "juniper-srx5600", "juniper-srx4600", "juniper-srx4100", "juniper-srx1500", "juniper-srx240h-poe", "juniper-vsrx", "juniper-srx5800", "juniper-srx4200"]}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.425 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-258b2460-f2f7-4231-844e-222abc3783b5', 'type': 'global_system_config', 'uuid': '953d4841-c203-4a7e-b905-387930676988'} 10/21/2024 02:01:56.516 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48sh-afi'] not found in DB: Unknown id: hardware juniper-qfx5100-48sh-afi 10/21/2024 02:01:56.516 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48sh-afi 10/21/2024 02:01:56.518 7fcaff1024e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afi url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afi"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.518 7fcaff1024e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afi url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afi"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.533 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afi', 'fq_name': ['juniper-qfx5100-48sh-afi'], 'id_perms': {'created': '2024-10-21T02:01:56.525396', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.525396', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11384058823132633680, 'uuid_mslong': 1438913218098056792}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '13f80bf2-bb59-4e58-9dfc-4d2f2ef8da50'}, 'oper': 'CREATE', 'request-id': 'req-0f82bd1b-94e6-4837-a605-5c9a15ecae99', 'type': 'hardware', 'uuid': '13f80bf2-bb59-4e58-9dfc-4d2f2ef8da50'} 10/21/2024 02:01:56.631 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48sh-afo'] not found in DB: Unknown id: hardware juniper-qfx5100-48sh-afo 10/21/2024 02:01:56.632 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48sh-afo 10/21/2024 02:01:56.633 7fcaff020438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afo url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afo"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.633 7fcaff020438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afo url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afo"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.750 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afo', 'fq_name': ['juniper-qfx5100-48sh-afo'], 'id_perms': {'created': '2024-10-21T02:01:56.710483', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.710483', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11907402550533406713, 'uuid_mslong': 8170178500335387112}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '71624e0f-0006-41e8-a53f-9788161fbff9'}, 'oper': 'CREATE', 'request-id': 'req-85665be1-9eb7-48d2-9f5b-11c6e69ce655', 'type': 'hardware', 'uuid': '71624e0f-0006-41e8-a53f-9788161fbff9'} 10/21/2024 02:01:56.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:56.857 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48th-afi'] not found in DB: Unknown id: hardware juniper-qfx5100-48th-afi 10/21/2024 02:01:56.857 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48th-afi 10/21/2024 02:01:56.859 7fcaff064048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afi url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afi"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.859 7fcaff064048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afi url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afi"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afi"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.876 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afi', 'fq_name': ['juniper-qfx5100-48th-afi'], 'id_perms': {'created': '2024-10-21T02:01:56.864862', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.864862', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11978359150258791860, 'uuid_mslong': 7797668654640352940}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '6c36e253-dc09-4eac-a63b-ae2edf39a5b4'}, 'oper': 'CREATE', 'request-id': 'req-4b329428-56be-443c-a50e-db7bcb12c91f', 'type': 'hardware', 'uuid': '6c36e253-dc09-4eac-a63b-ae2edf39a5b4'} 10/21/2024 02:01:56.976 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48th-afo'] not found in DB: Unknown id: hardware juniper-qfx5100-48th-afo 10/21/2024 02:01:56.977 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48th-afo 10/21/2024 02:01:56.978 7fcafef9ca20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afo url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afo"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.978 7fcafef9ca20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48th-afo url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48th-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48th-afo"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:56.996 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afo', 'fq_name': ['juniper-qfx5100-48th-afo'], 'id_perms': {'created': '2024-10-21T02:01:56.986393', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:56.986393', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12971507971411232210, 'uuid_mslong': 11678779352666423535}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'a2135bf1-c5d9-40ef-b404-0dc6251d45d2'}, 'oper': 'CREATE', 'request-id': 'req-4ce5b7a9-cbff-4237-beb4-7b6856e18c09', 'type': 'hardware', 'uuid': 'a2135bf1-c5d9-40ef-b404-0dc6251d45d2'} 10/21/2024 02:01:57.089 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48s-6q'] not found in DB: Unknown id: hardware juniper-qfx5100-48s-6q 10/21/2024 02:01:57.090 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48s-6q 10/21/2024 02:01:57.091 7fcaff02be10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48s-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48s-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.091 7fcaff02be10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48s-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48s-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.103 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48s-6q', 'fq_name': ['juniper-qfx5100-48s-6q'], 'id_perms': {'created': '2024-10-21T02:01:57.096818', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.096818', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10971976003419388221, 'uuid_mslong': 13040860839311330015}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'b4fa71d7-0474-4adf-9844-4a0b07ec393d'}, 'oper': 'CREATE', 'request-id': 'req-2a00006f-e92c-4446-982a-15d7036c4f08', 'type': 'hardware', 'uuid': 'b4fa71d7-0474-4adf-9844-4a0b07ec393d'} 10/21/2024 02:01:57.206 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-96s-8q'] not found in DB: Unknown id: hardware juniper-qfx5100-96s-8q 10/21/2024 02:01:57.207 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-96s-8q 10/21/2024 02:01:57.208 7fcafeea7d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-96s-8q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-96s-8q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.208 7fcafeea7d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-96s-8q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-96s-8q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.223 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100-96s-8q', 'fq_name': ['juniper-qfx5100-96s-8q'], 'id_perms': {'created': '2024-10-21T02:01:57.215316', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.215316', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13152944290393050038, 'uuid_mslong': 14685604257825705054}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'cbcdbf43-cbaa-4c5e-b688-a52513614bb6'}, 'oper': 'CREATE', 'request-id': 'req-c8971906-cbd8-4479-98cc-83b698758b4a', 'type': 'hardware', 'uuid': 'cbcdbf43-cbaa-4c5e-b688-a52513614bb6'} 10/21/2024 02:01:57.322 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48t'] not found in DB: Unknown id: hardware juniper-qfx5100-48t 10/21/2024 02:01:57.322 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48t 10/21/2024 02:01:57.323 7fcafef7dac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.323 7fcafef7dac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.336 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t', 'fq_name': ['juniper-qfx5100-48t'], 'id_perms': {'created': '2024-10-21T02:01:57.329626', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.329626', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10136933688300038954, 'uuid_mslong': 15506286799104852145}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'd73165b0-1df9-40b1-8cad-9f7b52d06b2a'}, 'oper': 'CREATE', 'request-id': 'req-c534f9c7-2366-4735-a7c9-6f13231a08d1', 'type': 'hardware', 'uuid': 'd73165b0-1df9-40b1-8cad-9f7b52d06b2a'} 10/21/2024 02:01:57.431 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-48t-6q'] not found in DB: Unknown id: hardware juniper-qfx5100-48t-6q 10/21/2024 02:01:57.432 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-48t-6q 10/21/2024 02:01:57.433 7fcafeef9588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.433 7fcafeef9588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.464 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t-6q', 'fq_name': ['juniper-qfx5100-48t-6q'], 'id_perms': {'created': '2024-10-21T02:01:57.438476', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.438476', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9484987063927997454, 'uuid_mslong': 13907771156991526058}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'c102542e-45e7-44aa-83a1-717b249a840e'}, 'oper': 'CREATE', 'request-id': 'req-5b5f9b79-af8a-49ec-9cd1-7f352157d032', 'type': 'hardware', 'uuid': 'c102542e-45e7-44aa-83a1-717b249a840e'} 10/21/2024 02:01:57.561 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-24q-2p'] not found in DB: Unknown id: hardware juniper-qfx5100-24q-2p 10/21/2024 02:01:57.562 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-24q-2p 10/21/2024 02:01:57.563 7fcaff000588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-2p url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-2p"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.563 7fcaff000588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-2p url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-2p"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.577 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-2p', 'fq_name': ['juniper-qfx5100-24q-2p'], 'id_perms': {'created': '2024-10-21T02:01:57.569058', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.569058', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10183313604486017219, 'uuid_mslong': 12083426141371911164}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'a7b0f40e-0a24-4bfc-8d52-65c50fcab0c3'}, 'oper': 'CREATE', 'request-id': 'req-f22b9513-f7cd-44fe-9aff-47b093b34b5d', 'type': 'hardware', 'uuid': 'a7b0f40e-0a24-4bfc-8d52-65c50fcab0c3'} 10/21/2024 02:01:57.677 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100-24q-aa'] not found in DB: Unknown id: hardware juniper-qfx5100-24q-aa 10/21/2024 02:01:57.677 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100-24q-aa 10/21/2024 02:01:57.678 7fcafef9b6d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-aa url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-aa"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-aa"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.678 7fcafef9b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-24q-aa url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-24q-aa"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-24q-aa"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.696 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-aa', 'fq_name': ['juniper-qfx5100-24q-aa'], 'id_perms': {'created': '2024-10-21T02:01:57.685548', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.685548', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12449780757512105175, 'uuid_mslong': 11041730365450177168}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '993c1b44-0a4d-4a90-acc6-81a31f00acd7'}, 'oper': 'CREATE', 'request-id': 'req-bd570502-dd84-47e2-945e-c7a7b8e2a6fe', 'type': 'hardware', 'uuid': '993c1b44-0a4d-4a90-acc6-81a31f00acd7'} 10/21/2024 02:01:57.792 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-48s-6q'] not found in DB: Unknown id: hardware juniper-qfx5100e-48s-6q 10/21/2024 02:01:57.793 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100e-48s-6q 10/21/2024 02:01:57.793 7fcafef5d438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48s-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48s-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.794 7fcafef5d438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48s-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48s-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:57.806 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48s-6q', 'fq_name': ['juniper-qfx5100e-48s-6q'], 'id_perms': {'created': '2024-10-21T02:01:57.799635', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.799635', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13057513358381312009, 'uuid_mslong': 4716389308469561344}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '4173fb16-69c7-4800-b535-9b37c03c6809'}, 'oper': 'CREATE', 'request-id': 'req-fffd629d-d7d6-4ad9-95a3-b58c0dd9ec2f', 'type': 'hardware', 'uuid': '4173fb16-69c7-4800-b535-9b37c03c6809'} 10/21/2024 02:01:57.905 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-96s-8q'] not found in DB: Unknown id: hardware juniper-qfx5100e-96s-8q 10/21/2024 02:01:57.905 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100e-96s-8q 10/21/2024 02:01:57.906 7fcafef34630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-96s-8q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-96s-8q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.906 7fcafef34630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-96s-8q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-96s-8q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-96s-8q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:57.922 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-96s-8q', 'fq_name': ['juniper-qfx5100e-96s-8q'], 'id_perms': {'created': '2024-10-21T02:01:57.912338', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:57.912338', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10906404615024743718, 'uuid_mslong': 1116242535684718900}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '0f7db0ac-0eab-4134-975b-5536773b1526'}, 'oper': 'CREATE', 'request-id': 'req-9e8be0d3-e5a5-4753-acb5-7ea23fac2475', 'type': 'hardware', 'uuid': '0f7db0ac-0eab-4134-975b-5536773b1526'} 10/21/2024 02:01:58.020 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-48t-6q'] not found in DB: Unknown id: hardware juniper-qfx5100e-48t-6q 10/21/2024 02:01:58.020 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100e-48t-6q 10/21/2024 02:01:58.021 7fcafef0b6d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48t-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48t-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.022 7fcafef0b6d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48t-6q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48t-6q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.036 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48t-6q', 'fq_name': ['juniper-qfx5100e-48t-6q'], 'id_perms': {'created': '2024-10-21T02:01:58.027408', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.027408', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10279034331046625301, 'uuid_mslong': 10203589788469576185}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '8d9a6eda-0788-41f9-8ea6-774370144015'}, 'oper': 'CREATE', 'request-id': 'req-92789f33-3c48-430d-b121-1cb03dcba1a6', 'type': 'hardware', 'uuid': '8d9a6eda-0788-41f9-8ea6-774370144015'} 10/21/2024 02:01:58.132 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5100e-24q-2p'] not found in DB: Unknown id: hardware juniper-qfx5100e-24q-2p 10/21/2024 02:01:58.132 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5100e-24q-2p 10/21/2024 02:01:58.133 7fcafefe4978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-24q-2p url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-24q-2p"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.133 7fcafefe4978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-24q-2p url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-24q-2p"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.145 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100e-24q-2p', 'fq_name': ['juniper-qfx5100e-24q-2p'], 'id_perms': {'created': '2024-10-21T02:01:58.138446', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.138446', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12700953419674288868, 'uuid_mslong': 17926067362159282125}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'f8c62f4a-1d3a-47cd-b042-d9d7b87802e4'}, 'oper': 'CREATE', 'request-id': 'req-7672d95f-1ae1-4294-a145-b82818a950ae', 'type': 'hardware', 'uuid': 'f8c62f4a-1d3a-47cd-b042-d9d7b87802e4'} 10/21/2024 02:01:58.244 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5110-48s-4c'] not found in DB: Unknown id: hardware juniper-qfx5110-48s-4c 10/21/2024 02:01:58.244 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5110-48s-4c 10/21/2024 02:01:58.245 7fcafefb0828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-48s-4c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-48s-4c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-48s-4c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.245 7fcafefb0828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-48s-4c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-48s-4c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-48s-4c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.285 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'obj_dict': {'display_name': 'juniper-qfx5110-48s-4c', 'fq_name': ['juniper-qfx5110-48s-4c'], 'id_perms': {'created': '2024-10-21T02:01:58.255663', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.255663', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12314739691007526673, 'uuid_mslong': 10939357769526429946}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '97d067ee-a388-48fa-aae6-be80afe84711'}, 'oper': 'CREATE', 'request-id': 'req-25756853-9aa2-4d14-ba82-be8e595b80b3', 'type': 'hardware', 'uuid': '97d067ee-a388-48fa-aae6-be80afe84711'} 10/21/2024 02:01:58.381 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5110-32q'] not found in DB: Unknown id: hardware juniper-qfx5110-32q 10/21/2024 02:01:58.382 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5110-32q 10/21/2024 02:01:58.383 7fcaff0564e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-32q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-32q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.383 7fcaff0564e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5110-32q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5110-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5110-32q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.404 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'obj_dict': {'display_name': 'juniper-qfx5110-32q', 'fq_name': ['juniper-qfx5110-32q'], 'id_perms': {'created': '2024-10-21T02:01:58.389762', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.389762', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11033093007228250240, 'uuid_mslong': 7183680530495783258}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '63b18f61-b817-415a-991d-6ba25dafa880'}, 'oper': 'CREATE', 'request-id': 'req-d4190e0a-a091-46b7-9acf-b8c5b4639608', 'type': 'hardware', 'uuid': '63b18f61-b817-415a-991d-6ba25dafa880'} 10/21/2024 02:01:58.498 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5120-48y-8c'] not found in DB: Unknown id: hardware juniper-qfx5120-48y-8c 10/21/2024 02:01:58.498 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5120-48y-8c 10/21/2024 02:01:58.500 7fcafef85f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48y-8c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48y-8c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48y-8c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.500 7fcafef85f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48y-8c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48y-8c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48y-8c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.531 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48y-8c', 'fq_name': ['juniper-qfx5120-48y-8c'], 'id_perms': {'created': '2024-10-21T02:01:58.522111', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.522111', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10321212969855153487, 'uuid_mslong': 9425368877290573758}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '82cda30e-5fed-4fbe-8f3c-50830f5ef54f'}, 'oper': 'CREATE', 'request-id': 'req-6970366c-26ff-4036-837d-a8405bf46242', 'type': 'hardware', 'uuid': '82cda30e-5fed-4fbe-8f3c-50830f5ef54f'} 10/21/2024 02:01:58.632 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5120-32c'] not found in DB: Unknown id: hardware juniper-qfx5120-32c 10/21/2024 02:01:58.633 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5120-32c 10/21/2024 02:01:58.634 7fcafef7d780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-32c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-32c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-32c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.634 7fcafef7d780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-32c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-32c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-32c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.651 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'obj_dict': {'display_name': 'juniper-qfx5120-32c', 'fq_name': ['juniper-qfx5120-32c'], 'id_perms': {'created': '2024-10-21T02:01:58.641459', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.641459', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12285420439160403339, 'uuid_mslong': 1326834486116303507}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '1269dcef-6cb3-4293-aa7e-94cc687ab58b'}, 'oper': 'CREATE', 'request-id': 'req-c649bf98-c2a1-4c59-a731-19302b9bbe70', 'type': 'hardware', 'uuid': '1269dcef-6cb3-4293-aa7e-94cc687ab58b'} 10/21/2024 02:01:58.749 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5120-48t-6c'] not found in DB: Unknown id: hardware juniper-qfx5120-48t-6c 10/21/2024 02:01:58.749 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5120-48t-6c 10/21/2024 02:01:58.750 7fcafeecf438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48t-6c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48t-6c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48t-6c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.751 7fcafeecf438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48t-6c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48t-6c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48t-6c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.767 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48t-6c', 'fq_name': ['juniper-qfx5120-48t-6c'], 'id_perms': {'created': '2024-10-21T02:01:58.757650', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.757650', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9912440830745586502, 'uuid_mslong': 9468961101949192221}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '836881f4-19ac-481d-8990-106acdab2b46'}, 'oper': 'CREATE', 'request-id': 'req-b7f583e2-ff0c-4cdc-8e6e-00dfd875acda', 'type': 'hardware', 'uuid': '836881f4-19ac-481d-8990-106acdab2b46'} 10/21/2024 02:01:58.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:58.861 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5220-32cd'] not found in DB: Unknown id: hardware juniper-qfx5220-32cd 10/21/2024 02:01:58.861 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5220-32cd 10/21/2024 02:01:58.862 7fcafef66c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-32cd url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-32cd"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-32cd"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.862 7fcafef66c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-32cd url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-32cd"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-32cd"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.883 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'obj_dict': {'display_name': 'juniper-qfx5220-32cd', 'fq_name': ['juniper-qfx5220-32cd'], 'id_perms': {'created': '2024-10-21T02:01:58.868245', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.868245', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12213479478758312135, 'uuid_mslong': 8953185979086687153}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '7c401b36-4378-4bb1-a97e-fee04ae988c7'}, 'oper': 'CREATE', 'request-id': 'req-d4ab71fe-3d75-4146-9a52-1c7efd3835c5', 'type': 'hardware', 'uuid': '7c401b36-4378-4bb1-a97e-fee04ae988c7'} 10/21/2024 02:01:58.979 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5220-128c'] not found in DB: Unknown id: hardware juniper-qfx5220-128c 10/21/2024 02:01:58.980 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5220-128c 10/21/2024 02:01:58.981 7fcafef0b438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-128c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-128c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-128c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:58.981 7fcafef0b438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-128c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-128c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-128c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.002 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'obj_dict': {'display_name': 'juniper-qfx5220-128c', 'fq_name': ['juniper-qfx5220-128c'], 'id_perms': {'created': '2024-10-21T02:01:58.986958', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:58.986958', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9994984007898588028, 'uuid_mslong': 3349568718880067298}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '2e7c0f00-c79b-4ee2-8ab5-50ffde81637c'}, 'oper': 'CREATE', 'request-id': 'req-231f7be2-40e4-441b-ae34-dca504ae49a7', 'type': 'hardware', 'uuid': '2e7c0f00-c79b-4ee2-8ab5-50ffde81637c'} 10/21/2024 02:01:59.092 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5200-32c-32q'] not found in DB: Unknown id: hardware juniper-qfx5200-32c-32q 10/21/2024 02:01:59.092 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5200-32c-32q 10/21/2024 02:01:59.093 7fcb0a88aeb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-32c-32q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-32c-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-32c-32q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.094 7fcb0a88aeb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-32c-32q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-32c-32q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-32c-32q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.113 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'obj_dict': {'display_name': 'juniper-qfx5200-32c-32q', 'fq_name': ['juniper-qfx5200-32c-32q'], 'id_perms': {'created': '2024-10-21T02:01:59.103643', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.103643', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13176671011010745107, 'uuid_mslong': 15913487631843346812}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'dcd810b0-1998-497c-b6dc-f078b57b9313'}, 'oper': 'CREATE', 'request-id': 'req-bec99de1-477e-4184-9c93-4d9fb8b144f2', 'type': 'hardware', 'uuid': 'dcd810b0-1998-497c-b6dc-f078b57b9313'} 10/21/2024 02:01:59.204 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5200-48y'] not found in DB: Unknown id: hardware juniper-qfx5200-48y 10/21/2024 02:01:59.205 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5200-48y 10/21/2024 02:01:59.206 7fcafef16390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-48y url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-48y"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-48y"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.206 7fcafef16390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-48y url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-48y"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-48y"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.224 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'obj_dict': {'display_name': 'juniper-qfx5200-48y', 'fq_name': ['juniper-qfx5200-48y'], 'id_perms': {'created': '2024-10-21T02:01:59.212838', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.212838', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11993303633880511783, 'uuid_mslong': 12548273500797618954}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'ae246c43-ef7d-4b0a-a670-c61c9cd97527'}, 'oper': 'CREATE', 'request-id': 'req-3f62bc8d-da7d-47a9-9744-6106b891e21c', 'type': 'hardware', 'uuid': 'ae246c43-ef7d-4b0a-a670-c61c9cd97527'} 10/21/2024 02:01:59.322 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx5210-64c'] not found in DB: Unknown id: hardware juniper-qfx5210-64c 10/21/2024 02:01:59.323 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx5210-64c 10/21/2024 02:01:59.324 7fcafeef90f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5210-64c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5210-64c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5210-64c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.324 7fcafeef90f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5210-64c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5210-64c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5210-64c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.350 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'obj_dict': {'display_name': 'juniper-qfx5210-64c', 'fq_name': ['juniper-qfx5210-64c'], 'id_perms': {'created': '2024-10-21T02:01:59.331303', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.331303', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13812102798521700682, 'uuid_mslong': 5417230649170739713}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '4b2dde92-de2e-4201-bfae-7250cb10914a'}, 'oper': 'CREATE', 'request-id': 'req-e86cf3c8-ed87-423f-882c-f4073f614fbf', 'type': 'hardware', 'uuid': '4b2dde92-de2e-4201-bfae-7250cb10914a'} 10/21/2024 02:01:59.448 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10002-72q'] not found in DB: Unknown id: hardware juniper-qfx10002-72q 10/21/2024 02:01:59.448 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx10002-72q 10/21/2024 02:01:59.449 7fcafef08978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-72q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-72q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-72q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.450 7fcafef08978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-72q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-72q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-72q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.467 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'obj_dict': {'display_name': 'juniper-qfx10002-72q', 'fq_name': ['juniper-qfx10002-72q'], 'id_perms': {'created': '2024-10-21T02:01:59.455705', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.455705', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10087653715571224960, 'uuid_mslong': 9467196147391811019}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '83623cbc-983c-4dcb-8bfe-8b9b8dc5b180'}, 'oper': 'CREATE', 'request-id': 'req-d4fdbce7-a6b5-415c-ba60-1fdd8373770d', 'type': 'hardware', 'uuid': '83623cbc-983c-4dcb-8bfe-8b9b8dc5b180'} 10/21/2024 02:01:59.568 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10002-36q'] not found in DB: Unknown id: hardware juniper-qfx10002-36q 10/21/2024 02:01:59.569 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx10002-36q 10/21/2024 02:01:59.570 7fcaff052390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-36q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-36q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-36q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.570 7fcaff052390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-36q url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-36q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-36q"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.595 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'obj_dict': {'display_name': 'juniper-qfx10002-36q', 'fq_name': ['juniper-qfx10002-36q'], 'id_perms': {'created': '2024-10-21T02:01:59.580231', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.580231', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10912106875815159491, 'uuid_mslong': 8830051703193422260}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '7a8aa53d-8d2d-49b4-976f-9763840f66c3'}, 'oper': 'CREATE', 'request-id': 'req-1103c2ff-c473-4194-bf5e-6cb9b476e2c7', 'type': 'hardware', 'uuid': '7a8aa53d-8d2d-49b4-976f-9763840f66c3'} 10/21/2024 02:01:59.684 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10002-60c'] not found in DB: Unknown id: hardware juniper-qfx10002-60c 10/21/2024 02:01:59.685 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx10002-60c 10/21/2024 02:01:59.686 7fcafef8ec18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-60c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-60c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-60c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.686 7fcafef8ec18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-60c url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-60c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-60c"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.694 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:01:59.694 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:01:59.694 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:01:59.694 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:01:59.695 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:01:59.695 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:01:59.695 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:01:59.695 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:01:59.695 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:01:59.695 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:01:59.696 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:01:59.696 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:01:59.696 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:01:59.696 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:01:59.696 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:01:59.696 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:01:59.697 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:01:59.697 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:01:59.697 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:01:59.697 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:01:59.697 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:01:59.697 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:01:59.698 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:01:59.699 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:01:59.699 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:01:59.699 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:01:59.699 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:01:59.699 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:01:59.699 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:01:59.700 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:01:59.701 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:01:59.701 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:01:59.701 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:01:59.701 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:01:59.701 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:01:59.701 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:01:59.702 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:01:59.703 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:01:59.703 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:01:59.703 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:01:59.703 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:01:59.703 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:01:59.703 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:01:59.704 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:01:59.724 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'obj_dict': {'display_name': 'juniper-qfx10002-60c', 'fq_name': ['juniper-qfx10002-60c'], 'id_perms': {'created': '2024-10-21T02:01:59.709532', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.709532', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9910394145044698444, 'uuid_mslong': 18170575612305886618}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'fc2ada3f-5fde-4d9a-8988-caf7a780154c'}, 'oper': 'CREATE', 'request-id': 'req-366fc4ff-0131-4243-8db9-31ca04529ced', 'type': 'hardware', 'uuid': 'fc2ada3f-5fde-4d9a-8988-caf7a780154c'} 10/21/2024 02:01:59.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:01:59.817 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: config_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:59.818 7fcafef2d6d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: config_node default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:01:59.819 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10016'] not found in DB: Unknown id: hardware juniper-qfx10016 10/21/2024 02:01:59.820 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx10016 10/21/2024 02:01:59.821 7fcafef94cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10016 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10016"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.821 7fcafef94cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10016 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10016"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.825 7fcafef0b390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.825 7fcafef0b390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = config_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/config-nodes operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_config_node.py remote_ip = 10.0.0.30 body = {"config-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "config_node_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.838 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10016'], 'obj_dict': {'display_name': 'juniper-qfx10016', 'fq_name': ['juniper-qfx10016'], 'id_perms': {'created': '2024-10-21T02:01:59.828707', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.828707', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11030783140916324177, 'uuid_mslong': 15913634461935750108}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'dcd8963a-a518-4bdc-9915-36d2b4af6751'}, 'oper': 'CREATE', 'request-id': 'req-c590c80b-2438-4659-a357-1bd907d5087c', 'type': 'hardware', 'uuid': 'dcd8963a-a518-4bdc-9915-36d2b4af6751'} 10/21/2024 02:01:59.860 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'config_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:01:59.849136', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.849136', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12958631564669760888, 'uuid_mslong': 8374965191296503086}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7439da78-117d-4d2e-b3d6-4ec0134e3578'}, 'oper': 'CREATE', 'request-id': 'req-f87598d3-5314-44fa-a3ec-d309e3ab90aa', 'type': 'config_node', 'uuid': '7439da78-117d-4d2e-b3d6-4ec0134e3578'} 10/21/2024 02:01:59.861 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ContrailConfigTrace] map 10/21/2024 02:01:59.937 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-qfx10008'] not found in DB: Unknown id: hardware juniper-qfx10008 10/21/2024 02:01:59.937 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-qfx10008 10/21/2024 02:01:59.938 7fcb135440f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10008 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10008"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.939 7fcb135440f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10008 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10008"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:01:59.957 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-qfx10008'], 'obj_dict': {'display_name': 'juniper-qfx10008', 'fq_name': ['juniper-qfx10008'], 'id_perms': {'created': '2024-10-21T02:01:59.945216', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:01:59.945216', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11487671724973994528, 'uuid_mslong': 8518618282288696833}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '76383631-b4f7-4e01-9f6c-6891cf5fb220'}, 'oper': 'CREATE', 'request-id': 'req-df341c3d-eacd-44ff-9e33-14e9fda5decf', 'type': 'hardware', 'uuid': '76383631-b4f7-4e01-9f6c-6891cf5fb220'} 10/21/2024 02:02:00.044 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-vqfx-10000'] not found in DB: Unknown id: hardware juniper-vqfx-10000 10/21/2024 02:02:00.045 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-vqfx-10000 10/21/2024 02:02:00.046 7fcaff0b1828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vqfx-10000 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vqfx-10000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vqfx-10000"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.046 7fcaff0b1828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vqfx-10000 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vqfx-10000"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vqfx-10000"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.059 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'obj_dict': {'display_name': 'juniper-vqfx-10000', 'fq_name': ['juniper-vqfx-10000'], 'id_perms': {'created': '2024-10-21T02:02:00.051531', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.051531', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12683622719392336165, 'uuid_mslong': 291397587190828630}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '040b408f-c8ea-4e56-b005-47a99e744925'}, 'oper': 'CREATE', 'request-id': 'req-d8bc7077-c763-4a47-91f4-954631227fce', 'type': 'hardware', 'uuid': '040b408f-c8ea-4e56-b005-47a99e744925'} 10/21/2024 02:02:00.158 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx80'] not found in DB: Unknown id: hardware juniper-mx80 10/21/2024 02:02:00.159 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx80 10/21/2024 02:02:00.160 7fcaff028b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.160 7fcaff028b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.174 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx80'], 'obj_dict': {'display_name': 'juniper-mx80', 'fq_name': ['juniper-mx80'], 'id_perms': {'created': '2024-10-21T02:02:00.167334', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.167334', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12419936143642457907, 'uuid_mslong': 13450741768230028737}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'baaaa25f-84dc-45c1-ac5c-7a1e76d7f733'}, 'oper': 'CREATE', 'request-id': 'req-8a5ec1f1-937c-4592-869e-0cc76d2f094b', 'type': 'hardware', 'uuid': 'baaaa25f-84dc-45c1-ac5c-7a1e76d7f733'} 10/21/2024 02:02:00.278 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx80-48t'] not found in DB: Unknown id: hardware juniper-mx80-48t 10/21/2024 02:02:00.278 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx80-48t 10/21/2024 02:02:00.281 7fcafeef9cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80-48t url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80-48t"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.281 7fcafeef9cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80-48t url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80-48t"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.301 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'obj_dict': {'display_name': 'juniper-mx80-48t', 'fq_name': ['juniper-mx80-48t'], 'id_perms': {'created': '2024-10-21T02:02:00.290881', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.290881', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11172239508579199009, 'uuid_mslong': 14458616859831584399}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'c8a7536d-d1bc-468f-9b0b-c4a3d672a821'}, 'oper': 'CREATE', 'request-id': 'req-fe135ae4-cd67-4981-ab38-9f2a553b343b', 'type': 'hardware', 'uuid': 'c8a7536d-d1bc-468f-9b0b-c4a3d672a821'} 10/21/2024 02:02:00.400 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx204'] not found in DB: Unknown id: hardware juniper-mx204 10/21/2024 02:02:00.440 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx204 10/21/2024 02:02:00.442 7fcafee5c780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx204 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx204"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx204"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.442 7fcafee5c780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx204 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx204"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx204"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.544 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx204'], 'obj_dict': {'display_name': 'juniper-mx204', 'fq_name': ['juniper-mx204'], 'id_perms': {'created': '2024-10-21T02:02:00.507048', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.507048', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11574875948327668547, 'uuid_mslong': 3957029108895006872}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '36ea3102-6191-4098-a0a2-385943488b43'}, 'oper': 'CREATE', 'request-id': 'req-b657aaf8-d684-4ae6-ae37-3394da03c78a', 'type': 'hardware', 'uuid': '36ea3102-6191-4098-a0a2-385943488b43'} 10/21/2024 02:02:00.648 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx240'] not found in DB: Unknown id: hardware juniper-mx240 10/21/2024 02:02:00.668 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx240 10/21/2024 02:02:00.670 7fcaff0210f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx240 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx240"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx240"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.670 7fcaff0210f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx240 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx240"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx240"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.715 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx240'], 'obj_dict': {'display_name': 'juniper-mx240', 'fq_name': ['juniper-mx240'], 'id_perms': {'created': '2024-10-21T02:02:00.704891', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.704891', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12491663540019799834, 'uuid_mslong': 7563109607219086367}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '68f5901d-dfa3-441f-ad5b-4dce5494271a'}, 'oper': 'CREATE', 'request-id': 'req-de39a876-4ffe-4b9d-94fd-eb90bcd2c80d', 'type': 'hardware', 'uuid': '68f5901d-dfa3-441f-ad5b-4dce5494271a'} 10/21/2024 02:02:00.759 7fcafeea76d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-peer-ip elements = { display_name : "label=fabric-peer-ip"fq_name : ["label=fabric-peer-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 18120055829450146548, "uuid_lslong": 9445540297513100434}, "enable": true, "created": "2024-10-21T02:01:55.801501", "last_modified": "2024-10-21T02:01:55.801501", "description": null, "user_visible": true, "creator": null}name : "label=fabric-peer-ip"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000003"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-peer-ip"uuid : "fb775ec5-d09f-42f4-8315-4cdb20e7e492" } deleted = False >> 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.760 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-pnf-servicechain-ip elements = { display_name : "label=fabric-pnf-servicechain-ip"fq_name : ["label=fabric-pnf-servicechain-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10170090969341184405, "uuid_lslong": 12967041880189221549}, "enable": true, "created": "2024-10-21T02:01:55.980781", "last_modified": "2024-10-21T02:01:55.980781", "description": null, "user_visible": true, "creator": null}name : "label=fabric-pnf-servicechain-ip"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000004"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-pnf-servicechain-ip"uuid : "8d236bda-68fd-4995-b3f4-2fe3404abaad" } deleted = False >> 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { analytics_snmp_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4922115650391591173, "uuid_lslong": 10102809568385547253}, "enable": true, "created": "2024-10-21T02:01:56.055536", "last_modified": "2024-10-21T02:01:56.055536", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "444ede1b-04fb-4905-8c34-63c68509bbf5" } deleted = False >> 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-as-number elements = { display_name : "label=fabric-as-number"fq_name : ["label=fabric-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10856301520373761942, "uuid_lslong": 13715819447873007730}, "enable": true, "created": "2024-10-21T02:01:56.133312", "last_modified": "2024-10-21T02:01:56.133312", "description": null, "user_visible": true, "creator": null}name : "label=fabric-as-number"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000005"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-as-number"uuid : "96a954b6-b069-4796-be58-611e49dd7072" } deleted = False >> 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-ebgp-as-number elements = { display_name : "label=fabric-ebgp-as-number"fq_name : ["label=fabric-ebgp-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3064774810826262391, "uuid_lslong": 13269267870521330949}, "enable": true, "created": "2024-10-21T02:01:56.256351", "last_modified": "2024-10-21T02:01:56.256351", "description": null, "user_visible": true, "creator": null}name : "label=fabric-ebgp-as-number"perms2 : {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000006"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "9f878138-10fd-450a-8367-eda5f19e7cc9", "to": ["label"]}]tag_value : "fabric-ebgp-as-number"uuid : "2a884473-dbdd-4777-b825-e8d31bed8d05" } deleted = False >> 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.761 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { config_node_ip_address : "10.0.0.30"display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 8374965191296503086, "uuid_lslong": 12958631564669760888}, "enable": true, "created": "2024-10-21T02:01:59.849136", "last_modified": "2024-10-21T02:01:59.849136", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "7439da78-117d-4d2e-b3d6-4ec0134e3578" } deleted = False >> 10/21/2024 02:02:00.762 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:00.762 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:00.762 7fcafeea76d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:00.762 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.762 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:00.762 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.763 7fcafeea76d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.763 7fcafeea76d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:00.763 7fcafeea76d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:00.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:00.812 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx480'] not found in DB: Unknown id: hardware juniper-mx480 10/21/2024 02:02:00.813 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx480 10/21/2024 02:02:00.813 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx480 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx480"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx480"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.853 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx480'], 'obj_dict': {'display_name': 'juniper-mx480', 'fq_name': ['juniper-mx480'], 'id_perms': {'created': '2024-10-21T02:02:00.831934', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.831934', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10978340959760201813, 'uuid_mslong': 14343465623561391625}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'c70e39fd-5c67-4e09-985a-e6efe9a0b855'}, 'oper': 'CREATE', 'request-id': 'req-03efa647-3662-4cdb-ae46-f80175006056', 'type': 'hardware', 'uuid': 'c70e39fd-5c67-4e09-985a-e6efe9a0b855'} 10/21/2024 02:02:00.938 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx960'] not found in DB: Unknown id: hardware juniper-mx960 10/21/2024 02:02:00.938 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx960 10/21/2024 02:02:00.939 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx960 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx960"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx960"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:00.962 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx960'], 'obj_dict': {'display_name': 'juniper-mx960', 'fq_name': ['juniper-mx960'], 'id_perms': {'created': '2024-10-21T02:02:00.947853', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:00.947853', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9791220378910332909, 'uuid_mslong': 6725931118148208432}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '5d574eb7-68f8-4730-87e1-670efa8417ed'}, 'oper': 'CREATE', 'request-id': 'req-e3d98a43-fa9a-4cff-8197-ba45e2b6a05f', 'type': 'hardware', 'uuid': '5d574eb7-68f8-4730-87e1-670efa8417ed'} 10/21/2024 02:02:01.063 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx2008'] not found in DB: Unknown id: hardware juniper-mx2008 10/21/2024 02:02:01.064 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx2008 10/21/2024 02:02:01.064 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2008 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2008"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.105 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx2008'], 'obj_dict': {'display_name': 'juniper-mx2008', 'fq_name': ['juniper-mx2008'], 'id_perms': {'created': '2024-10-21T02:02:01.094067', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.094067', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11076075390944570271, 'uuid_mslong': 11440301740820022190}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '9ec41dd1-e8dc-43ae-99b6-1fe26eb26b9f'}, 'oper': 'CREATE', 'request-id': 'req-898b3343-93b1-4904-8fe6-f3c34eef3e40', 'type': 'hardware', 'uuid': '9ec41dd1-e8dc-43ae-99b6-1fe26eb26b9f'} 10/21/2024 02:02:01.206 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx2010'] not found in DB: Unknown id: hardware juniper-mx2010 10/21/2024 02:02:01.206 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx2010 10/21/2024 02:02:01.207 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2010 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2010"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2010"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.225 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx2010'], 'obj_dict': {'display_name': 'juniper-mx2010', 'fq_name': ['juniper-mx2010'], 'id_perms': {'created': '2024-10-21T02:02:01.214666', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.214666', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11507755233903427133, 'uuid_mslong': 17335686041376933746}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'f094ba9b-31f8-4772-9fb3-c26a1ef4be3d'}, 'oper': 'CREATE', 'request-id': 'req-a81a3cac-d6f8-4c29-b0a0-0dc6d3487e1d', 'type': 'hardware', 'uuid': 'f094ba9b-31f8-4772-9fb3-c26a1ef4be3d'} 10/21/2024 02:02:01.321 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx2020'] not found in DB: Unknown id: hardware juniper-mx2020 10/21/2024 02:02:01.321 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx2020 10/21/2024 02:02:01.322 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2020 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2020"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2020"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.377 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx2020'], 'obj_dict': {'display_name': 'juniper-mx2020', 'fq_name': ['juniper-mx2020'], 'id_perms': {'created': '2024-10-21T02:02:01.345028', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.345028', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11097652643306524505, 'uuid_mslong': 11460977298120065550}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '9f0d9221-3943-420e-9a02-c847fcf5cf59'}, 'oper': 'CREATE', 'request-id': 'req-f1302d6f-9838-4f6f-8778-f3c6ec122612', 'type': 'hardware', 'uuid': '9f0d9221-3943-420e-9a02-c847fcf5cf59'} 10/21/2024 02:02:01.472 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-mx10003'] not found in DB: Unknown id: hardware juniper-mx10003 10/21/2024 02:02:01.508 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-mx10003 10/21/2024 02:02:01.508 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx10003 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx10003"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx10003"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.544 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-mx10003'], 'obj_dict': {'display_name': 'juniper-mx10003', 'fq_name': ['juniper-mx10003'], 'id_perms': {'created': '2024-10-21T02:02:01.532059', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.532059', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13437903156209886911, 'uuid_mslong': 12771722476755567429}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'b13e45ec-d4e3-4345-ba7d-05b937fda6bf'}, 'oper': 'CREATE', 'request-id': 'req-8a0582be-3eee-4ca1-b558-68be8dca2618', 'type': 'hardware', 'uuid': 'b13e45ec-d4e3-4345-ba7d-05b937fda6bf'} 10/21/2024 02:02:01.643 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-jnp10008'] not found in DB: Unknown id: hardware juniper-jnp10008 10/21/2024 02:02:01.655 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-jnp10008 10/21/2024 02:02:01.656 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-jnp10008 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-jnp10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-jnp10008"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.679 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-jnp10008'], 'obj_dict': {'display_name': 'juniper-jnp10008', 'fq_name': ['juniper-jnp10008'], 'id_perms': {'created': '2024-10-21T02:02:01.668839', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.668839', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11293275867392400496, 'uuid_mslong': 5467072347514031016}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '4bdef155-92ef-4ba8-9cb9-c6912a6a5c70'}, 'oper': 'CREATE', 'request-id': 'req-668c1ebc-3c31-4d77-8885-54a74806c20c', 'type': 'hardware', 'uuid': '4bdef155-92ef-4ba8-9cb9-c6912a6a5c70'} 10/21/2024 02:02:01.772 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-jnp10016'] not found in DB: Unknown id: hardware juniper-jnp10016 10/21/2024 02:02:01.773 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-jnp10016 10/21/2024 02:02:01.773 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-jnp10016 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-jnp10016"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-jnp10016"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:01.859 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-jnp10016'], 'obj_dict': {'display_name': 'juniper-jnp10016', 'fq_name': ['juniper-jnp10016'], 'id_perms': {'created': '2024-10-21T02:02:01.821667', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.821667', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9528849073273499077, 'uuid_mslong': 4584886634808951079}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '3fa0ca1a-4339-4127-843d-45bf02c6edc5'}, 'oper': 'CREATE', 'request-id': 'req-61af5651-79bb-459a-bf25-a8d963fa6efa', 'type': 'hardware', 'uuid': '3fa0ca1a-4339-4127-843d-45bf02c6edc5'} 10/21/2024 02:02:01.960 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-vmx'] not found in DB: Unknown id: hardware juniper-vmx 10/21/2024 02:02:01.961 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-vmx 10/21/2024 02:02:01.961 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vmx url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vmx"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vmx"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:01.996 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-vmx'], 'obj_dict': {'display_name': 'juniper-vmx', 'fq_name': ['juniper-vmx'], 'id_perms': {'created': '2024-10-21T02:02:01.970535', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:01.970535', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9937334291625705251, 'uuid_mslong': 10706640700815589728}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '9495a0fd-bdda-4160-89e8-80e352a87f23'}, 'oper': 'CREATE', 'request-id': 'req-6d5e0a73-c2f2-4e7b-b30d-d82f8d3d358e', 'type': 'hardware', 'uuid': '9495a0fd-bdda-4160-89e8-80e352a87f23'} 10/21/2024 02:02:02.107 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx5400'] not found in DB: Unknown id: hardware juniper-srx5400 10/21/2024 02:02:02.108 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx5400 10/21/2024 02:02:02.109 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5400 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5400"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5400"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.126 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx5400'], 'obj_dict': {'display_name': 'juniper-srx5400', 'fq_name': ['juniper-srx5400'], 'id_perms': {'created': '2024-10-21T02:02:02.116152', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.116152', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11583226425661781763, 'uuid_mslong': 3206272095117462044}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '2c7ef77b-a2b9-4a1c-a0bf-e310467cf703'}, 'oper': 'CREATE', 'request-id': 'req-63325379-8fca-4e97-b759-b2ab5605de2a', 'type': 'hardware', 'uuid': '2c7ef77b-a2b9-4a1c-a0bf-e310467cf703'} 10/21/2024 02:02:02.231 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx5600'] not found in DB: Unknown id: hardware juniper-srx5600 10/21/2024 02:02:02.231 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx5600 10/21/2024 02:02:02.232 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5600 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5600"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5600"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.252 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx5600'], 'obj_dict': {'display_name': 'juniper-srx5600', 'fq_name': ['juniper-srx5600'], 'id_perms': {'created': '2024-10-21T02:02:02.239828', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.239828', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12730503687221723976, 'uuid_mslong': 13777411541341980968}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'bf3332cd-0e0e-4928-b0ab-d5a788a6c348'}, 'oper': 'CREATE', 'request-id': 'req-8cc8e122-cd04-445d-91ba-ddeb396bc83b', 'type': 'hardware', 'uuid': 'bf3332cd-0e0e-4928-b0ab-d5a788a6c348'} 10/21/2024 02:02:02.352 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx4600'] not found in DB: Unknown id: hardware juniper-srx4600 10/21/2024 02:02:02.352 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx4600 10/21/2024 02:02:02.353 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4600 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4600"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4600"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.371 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx4600'], 'obj_dict': {'display_name': 'juniper-srx4600', 'fq_name': ['juniper-srx4600'], 'id_perms': {'created': '2024-10-21T02:02:02.358792', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.358792', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10136344070723862061, 'uuid_mslong': 3784126626898397106}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '3483eb1e-3560-47b2-8cab-873a48a1fe2d'}, 'oper': 'CREATE', 'request-id': 'req-173706d6-13b1-4080-b759-267870e56b89', 'type': 'hardware', 'uuid': '3483eb1e-3560-47b2-8cab-873a48a1fe2d'} 10/21/2024 02:02:02.472 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx4100'] not found in DB: Unknown id: hardware juniper-srx4100 10/21/2024 02:02:02.474 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx4100 10/21/2024 02:02:02.475 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4100 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4100"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4100"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.499 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx4100'], 'obj_dict': {'display_name': 'juniper-srx4100', 'fq_name': ['juniper-srx4100'], 'id_perms': {'created': '2024-10-21T02:02:02.483208', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.483208', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12240326028517138048, 'uuid_mslong': 3050233581587678492}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '2a549b48-1880-451c-a9de-5fabc0bb5e80'}, 'oper': 'CREATE', 'request-id': 'req-7be4696d-69c6-473c-a64c-769d2afc4f85', 'type': 'hardware', 'uuid': '2a549b48-1880-451c-a9de-5fabc0bb5e80'} 10/21/2024 02:02:02.595 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx1500'] not found in DB: Unknown id: hardware juniper-srx1500 10/21/2024 02:02:02.595 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx1500 10/21/2024 02:02:02.596 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx1500 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx1500"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx1500"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.616 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx1500'], 'obj_dict': {'display_name': 'juniper-srx1500', 'fq_name': ['juniper-srx1500'], 'id_perms': {'created': '2024-10-21T02:02:02.604865', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.604865', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10444351391901734630, 'uuid_mslong': 16164317455848718718}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'e0533115-7882-417e-90f1-ca411fa8d6e6'}, 'oper': 'CREATE', 'request-id': 'req-e2efc0a3-298e-4eb7-8c5a-96e258d4451d', 'type': 'hardware', 'uuid': 'e0533115-7882-417e-90f1-ca411fa8d6e6'} 10/21/2024 02:02:02.718 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx240h-poe'] not found in DB: Unknown id: hardware juniper-srx240h-poe 10/21/2024 02:02:02.719 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx240h-poe 10/21/2024 02:02:02.720 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx240h-poe url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx240h-poe"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx240h-poe"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.734 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'obj_dict': {'display_name': 'juniper-srx240h-poe', 'fq_name': ['juniper-srx240h-poe'], 'id_perms': {'created': '2024-10-21T02:02:02.727997', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.727997', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12163653339600507710, 'uuid_mslong': 4101035050384310552}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '38e9cda6-6d95-4118-a8cd-fa443de1d33e'}, 'oper': 'CREATE', 'request-id': 'req-4b0dbeab-a5c5-4f59-9155-82604cf0f111', 'type': 'hardware', 'uuid': '38e9cda6-6d95-4118-a8cd-fa443de1d33e'} 10/21/2024 02:02:02.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:02.832 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx5800'] not found in DB: Unknown id: hardware juniper-srx5800 10/21/2024 02:02:02.832 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx5800 10/21/2024 02:02:02.833 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5800 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5800"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5800"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.846 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx5800'], 'obj_dict': {'display_name': 'juniper-srx5800', 'fq_name': ['juniper-srx5800'], 'id_perms': {'created': '2024-10-21T02:02:02.838294', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.838294', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10254662601922841075, 'uuid_mslong': 4902086042786024289}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '4407b548-96a9-4b61-8e4f-e14e0f1809f3'}, 'oper': 'CREATE', 'request-id': 'req-0e489095-d838-42ab-a76e-a3e29389f88a', 'type': 'hardware', 'uuid': '4407b548-96a9-4b61-8e4f-e14e0f1809f3'} 10/21/2024 02:02:02.948 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-srx4200'] not found in DB: Unknown id: hardware juniper-srx4200 10/21/2024 02:02:02.948 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-srx4200 10/21/2024 02:02:02.949 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4200 url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4200"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4200"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:02.974 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-srx4200'], 'obj_dict': {'display_name': 'juniper-srx4200', 'fq_name': ['juniper-srx4200'], 'id_perms': {'created': '2024-10-21T02:02:02.955647', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:02.955647', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12983895422187978116, 'uuid_mslong': 9058661712804201967}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '7db6d4d5-3c20-45ef-b430-10184855bd84'}, 'oper': 'CREATE', 'request-id': 'req-4aa057f3-2c8e-4a5e-aaba-679db0ea9f8e', 'type': 'hardware', 'uuid': '7db6d4d5-3c20-45ef-b430-10184855bd84'} 10/21/2024 02:02:03.071 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['juniper-vsrx'] not found in DB: Unknown id: hardware juniper-vsrx 10/21/2024 02:02:03.072 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: hardware juniper-vsrx 10/21/2024 02:02:03.074 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-vsrx url = https://10.0.0.30:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"hardware": {"uuid": null, "fq_name": ["juniper-vsrx"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-vsrx"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.108 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['juniper-vsrx'], 'obj_dict': {'display_name': 'juniper-vsrx', 'fq_name': ['juniper-vsrx'], 'id_perms': {'created': '2024-10-21T02:02:03.082242', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.082242', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12851863643677715540, 'uuid_mslong': 10580725174862892704}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': '92d6497c-c9bc-4ea0-b25a-fde44f2aec54'}, 'oper': 'CREATE', 'request-id': 'req-b916e285-4346-4985-af99-c05db7aa3bd7', 'type': 'hardware', 'uuid': '92d6497c-c9bc-4ea0-b25a-fde44f2aec54'} 10/21/2024 02:02:03.203 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'underlay-ip-clos'] not found in DB: Unknown id: feature default-global-system-config:underlay-ip-clos 10/21/2024 02:02:03.205 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:underlay-ip-clos 10/21/2024 02:02:03.216 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:underlay-ip-clos url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "underlay-ip-clos"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "underlay-ip-clos"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.238 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'obj_dict': {'display_name': 'underlay-ip-clos', 'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'id_perms': {'created': '2024-10-21T02:02:03.230224', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.230224', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10808386507460341541, 'uuid_mslong': 18219511249105863070}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fcd8b4f3-3030-419e-95ff-1a43644c6f25'}, 'oper': 'CREATE', 'request-id': 'req-6b902a8d-a9a8-4e53-87f9-07f9b33aa830', 'type': 'feature', 'uuid': 'fcd8b4f3-3030-419e-95ff-1a43644c6f25'} 10/21/2024 02:02:03.344 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'overlay-bgp'] not found in DB: Unknown id: feature default-global-system-config:overlay-bgp 10/21/2024 02:02:03.345 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:overlay-bgp 10/21/2024 02:02:03.349 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:overlay-bgp url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "overlay-bgp"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "overlay-bgp"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.368 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'obj_dict': {'display_name': 'overlay-bgp', 'fq_name': ['default-global-system-config', 'overlay-bgp'], 'id_perms': {'created': '2024-10-21T02:02:03.361361', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.361361', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9797351760860044719, 'uuid_mslong': 16876128075986915220}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ea340d12-5132-4f94-87f7-2f84959c5daf'}, 'oper': 'CREATE', 'request-id': 'req-acd6dd3a-dc77-4845-b64b-38b0a2d29f54', 'type': 'feature', 'uuid': 'ea340d12-5132-4f94-87f7-2f84959c5daf'} 10/21/2024 02:02:03.468 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'l2-gateway'] not found in DB: Unknown id: feature default-global-system-config:l2-gateway 10/21/2024 02:02:03.468 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:l2-gateway 10/21/2024 02:02:03.474 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l2-gateway url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l2-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l2-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.579 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'obj_dict': {'display_name': 'l2-gateway', 'fq_name': ['default-global-system-config', 'l2-gateway'], 'id_perms': {'created': '2024-10-21T02:02:03.544759', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.544759', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12201698808119979903, 'uuid_mslong': 13010825354511401719}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b48fbcb9-c24c-42f7-a955-246b2a4c6f7f'}, 'oper': 'CREATE', 'request-id': 'req-620db92f-05f7-483e-bfd2-8644996fd17e', 'type': 'feature', 'uuid': 'b48fbcb9-c24c-42f7-a955-246b2a4c6f7f'} 10/21/2024 02:02:03.672 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'l3-gateway'] not found in DB: Unknown id: feature default-global-system-config:l3-gateway 10/21/2024 02:02:03.673 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:l3-gateway 10/21/2024 02:02:03.685 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l3-gateway url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l3-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.717 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'fq_name': ['default-global-system-config', 'l3-gateway'], 'id_perms': {'created': '2024-10-21T02:02:03.705167', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.705167', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9266296695184595811, 'uuid_mslong': 14111250914339998092}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c3d53bf1-25a4-498c-8098-7fbfd3da9b63'}, 'oper': 'CREATE', 'request-id': 'req-b00d1885-b5f3-4b29-afa8-c8ad5243ae3a', 'type': 'feature', 'uuid': 'c3d53bf1-25a4-498c-8098-7fbfd3da9b63'} 10/21/2024 02:02:03.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:03.821 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'vn-interconnect'] not found in DB: Unknown id: feature default-global-system-config:vn-interconnect 10/21/2024 02:02:03.822 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:vn-interconnect 10/21/2024 02:02:03.828 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:vn-interconnect url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "vn-interconnect"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vn-interconnect"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.856 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'obj_dict': {'display_name': 'vn-interconnect', 'fq_name': ['default-global-system-config', 'vn-interconnect'], 'id_perms': {'created': '2024-10-21T02:02:03.841449', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.841449', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12433873778330827790, 'uuid_mslong': 2066589551404270600}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1cae003f-6bfc-4408-ac8d-fe52eb73fc0e'}, 'oper': 'CREATE', 'request-id': 'req-28bbe2b1-ae1a-4d1d-ac74-3c7890c6e4f9', 'type': 'feature', 'uuid': '1cae003f-6bfc-4408-ac8d-fe52eb73fc0e'} 10/21/2024 02:02:03.948 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway'] not found in DB: Unknown id: feature default-global-system-config:dc-gateway 10/21/2024 02:02:03.949 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:dc-gateway 10/21/2024 02:02:03.956 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:03.985 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2024-10-21T02:02:03.974676', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:03.974676', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10793052564083901029, 'uuid_mslong': 12310125179964575112}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aad659a1-1c61-4d88-95c8-a01f7c570265'}, 'oper': 'CREATE', 'request-id': 'req-c852a156-36ac-4d59-90f3-ce7b8dcd308a', 'type': 'feature', 'uuid': 'aad659a1-1c61-4d88-95c8-a01f7c570265'} 10/21/2024 02:02:04.081 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'assisted-replicator'] not found in DB: Unknown id: feature default-global-system-config:assisted-replicator 10/21/2024 02:02:04.081 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:assisted-replicator 10/21/2024 02:02:04.087 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:assisted-replicator url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "assisted-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.114 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'fq_name': ['default-global-system-config', 'assisted-replicator'], 'id_perms': {'created': '2024-10-21T02:02:04.099147', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.099147', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13470764427604552172, 'uuid_mslong': 850390372885414725}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0bcd3189-e03f-4345-baf1-c4e0305669ec'}, 'oper': 'CREATE', 'request-id': 'req-0ec46fe0-750f-4d8e-9c74-faf36e6cb8fd', 'type': 'feature', 'uuid': '0bcd3189-e03f-4345-baf1-c4e0305669ec'} 10/21/2024 02:02:04.206 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'port-profile'] not found in DB: Unknown id: feature default-global-system-config:port-profile 10/21/2024 02:02:04.206 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:port-profile 10/21/2024 02:02:04.213 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:port-profile url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "port-profile"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "port-profile"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.239 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'obj_dict': {'display_name': 'port-profile', 'fq_name': ['default-global-system-config', 'port-profile'], 'id_perms': {'created': '2024-10-21T02:02:04.228912', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.228912', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12148931104631077980, 'uuid_mslong': 12646774724041787285}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'af825e9b-24e6-4795-a899-ac78cc3abc5c'}, 'oper': 'CREATE', 'request-id': 'req-1d2386a7-899b-4532-a454-abce2ecb73d7', 'type': 'feature', 'uuid': 'af825e9b-24e6-4795-a899-ac78cc3abc5c'} 10/21/2024 02:02:04.336 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'telemetry'] not found in DB: Unknown id: feature default-global-system-config:telemetry 10/21/2024 02:02:04.336 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:telemetry 10/21/2024 02:02:04.341 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:telemetry url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "telemetry"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "telemetry"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.358 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'obj_dict': {'display_name': 'telemetry', 'fq_name': ['default-global-system-config', 'telemetry'], 'id_perms': {'created': '2024-10-21T02:02:04.351376', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.351376', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11098751676055855104, 'uuid_mslong': 3060603020764596339}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2a79723b-4b29-4873-9a06-afd87d94a000'}, 'oper': 'CREATE', 'request-id': 'req-4a59861f-352f-4ccf-89b6-2356f0214049', 'type': 'feature', 'uuid': '2a79723b-4b29-4873-9a06-afd87d94a000'} 10/21/2024 02:02:04.452 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'firewall'] not found in DB: Unknown id: feature default-global-system-config:firewall 10/21/2024 02:02:04.453 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:firewall 10/21/2024 02:02:04.458 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:firewall url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "firewall"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "firewall"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.490 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'obj_dict': {'display_name': 'firewall', 'fq_name': ['default-global-system-config', 'firewall'], 'id_perms': {'created': '2024-10-21T02:02:04.482550', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.482550', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12650172898834426645, 'uuid_mslong': 11803040445319105206}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15'}, 'oper': 'CREATE', 'request-id': 'req-8713e009-be12-4d6e-81c1-f519d231ca56', 'type': 'feature', 'uuid': 'a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15'} 10/21/2024 02:02:04.588 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'infra-bms-access'] not found in DB: Unknown id: feature default-global-system-config:infra-bms-access 10/21/2024 02:02:04.589 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:infra-bms-access 10/21/2024 02:02:04.594 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:infra-bms-access url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "infra-bms-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "infra-bms-access"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.619 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'obj_dict': {'display_name': 'infra-bms-access', 'fq_name': ['default-global-system-config', 'infra-bms-access'], 'id_perms': {'created': '2024-10-21T02:02:04.610541', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.610541', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9347190423726456394, 'uuid_mslong': 726788209066591836}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0a161206-845b-465c-81b7-e42ab625fe4a'}, 'oper': 'CREATE', 'request-id': 'req-3ea37b6c-3db4-471c-bc76-ed26fbec853e', 'type': 'feature', 'uuid': '0a161206-845b-465c-81b7-e42ab625fe4a'} 10/21/2024 02:02:04.721 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-service-chaining'] not found in DB: Unknown id: feature default-global-system-config:pnf-service-chaining 10/21/2024 02:02:04.723 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature default-global-system-config:pnf-service-chaining 10/21/2024 02:02:04.730 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:pnf-service-chaining url = https://10.0.0.30:8082/features operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-service-chaining"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-service-chaining"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.758 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'obj_dict': {'display_name': 'pnf-service-chaining', 'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'id_perms': {'created': '2024-10-21T02:02:04.750776', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.750776', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13709210989082311540, 'uuid_mslong': 14001033455102807300}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c24da9bf-2bc3-4d04-be40-e6c29321fb74'}, 'oper': 'CREATE', 'request-id': 'req-f717067a-68a8-4212-92c1-c9a2c91c6f55', 'type': 'feature', 'uuid': 'c24da9bf-2bc3-4d04-be40-e6c29321fb74'} 10/21/2024 02:02:04.760 7fcafefb0d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:04.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:04.866 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'leaf'] not found in DB: Unknown id: physical_role default-global-system-config:leaf 10/21/2024 02:02:04.866 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: physical_role default-global-system-config:leaf 10/21/2024 02:02:04.872 7fcaff77e828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:leaf url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.872 7fcaff77e828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:leaf url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:04.898 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'obj_dict': {'display_name': 'leaf', 'fq_name': ['default-global-system-config', 'leaf'], 'id_perms': {'created': '2024-10-21T02:02:04.889637', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:04.889637', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13100266590411869099, 'uuid_mslong': 15835765511325698791}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab'}, 'oper': 'CREATE', 'request-id': 'req-8bdc26a2-87e7-41e3-8a63-eb60375b450b', 'type': 'physical_role', 'uuid': 'dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab'} 10/21/2024 02:02:05.000 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'spine'] not found in DB: Unknown id: physical_role default-global-system-config:spine 10/21/2024 02:02:05.001 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: physical_role default-global-system-config:spine 10/21/2024 02:02:05.009 7fcaff01c630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:spine url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.010 7fcaff01c630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:spine url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.034 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'obj_dict': {'display_name': 'spine', 'fq_name': ['default-global-system-config', 'spine'], 'id_perms': {'created': '2024-10-21T02:02:05.024004', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.024004', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12214484840108065619, 'uuid_mslong': 10525736702698538121}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9212edc3-6ba3-4489-a982-913f39090353'}, 'oper': 'CREATE', 'request-id': 'req-53927658-db32-4eef-b89b-62b0a60908d4', 'type': 'physical_role', 'uuid': '9212edc3-6ba3-4489-a982-913f39090353'} 10/21/2024 02:02:05.127 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'superspine'] not found in DB: Unknown id: physical_role default-global-system-config:superspine 10/21/2024 02:02:05.128 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: physical_role default-global-system-config:superspine 10/21/2024 02:02:05.134 7fcafef2d630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:superspine url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "superspine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.135 7fcafef2d630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:superspine url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "superspine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.169 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'obj_dict': {'display_name': 'superspine', 'fq_name': ['default-global-system-config', 'superspine'], 'id_perms': {'created': '2024-10-21T02:02:05.153023', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.153023', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12134712152752558584, 'uuid_mslong': 999107572086949977}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0ddd8b0b-16a5-4859-a867-2869146e91f8'}, 'oper': 'CREATE', 'request-id': 'req-1c8fd536-6752-4c87-bbdd-b36bf352d2a6', 'type': 'physical_role', 'uuid': '0ddd8b0b-16a5-4859-a867-2869146e91f8'} 10/21/2024 02:02:05.266 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf'] not found in DB: Unknown id: physical_role default-global-system-config:pnf 10/21/2024 02:02:05.267 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: physical_role default-global-system-config:pnf 10/21/2024 02:02:05.282 7fcafefd0630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:pnf url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.282 7fcafefd0630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:pnf url = https://10.0.0.30:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.314 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'obj_dict': {'display_name': 'pnf', 'fq_name': ['default-global-system-config', 'pnf'], 'id_perms': {'created': '2024-10-21T02:02:05.298778', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.298778', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12751853570245951401, 'uuid_mslong': 515069961533997262}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0725e566-abb5-40ce-b0f7-af428a4e7fa9'}, 'oper': 'CREATE', 'request-id': 'req-a085fa9c-9dec-4ef9-a223-adb5b21a4b96', 'type': 'physical_role', 'uuid': '0725e566-abb5-40ce-b0f7-af428a4e7fa9'} 10/21/2024 02:02:05.414 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'erb-ucast-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:erb-ucast-gateway 10/21/2024 02:02:05.414 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:erb-ucast-gateway 10/21/2024 02:02:05.424 7fcafef470f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:erb-ucast-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "erb-ucast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-ucast-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.424 7fcafef470f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:erb-ucast-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "erb-ucast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-ucast-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.486 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'obj_dict': {'display_name': 'erb-ucast-gateway', 'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'id_perms': {'created': '2024-10-21T02:02:05.451831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.451831', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12799222362465169176, 'uuid_mslong': 8159396746957966468}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '713c001c-6be8-4c84-b19f-f8ecebf8ef18'}, 'oper': 'CREATE', 'request-id': 'req-fe5f07d4-259a-4183-a0f7-2f6b2b3b6e07', 'type': 'overlay_role', 'uuid': '713c001c-6be8-4c84-b19f-f8ecebf8ef18'} 10/21/2024 02:02:05.570 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-access'] not found in DB: Unknown id: overlay_role default-global-system-config:crb-access 10/21/2024 02:02:05.570 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:crb-access 10/21/2024 02:02:05.576 7fcafef58c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-access url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.576 7fcafef58c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-access url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.610 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'obj_dict': {'display_name': 'crb-access', 'fq_name': ['default-global-system-config', 'crb-access'], 'id_perms': {'created': '2024-10-21T02:02:05.595150', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.595150', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10464275812159829988, 'uuid_mslong': 15472527009975781381}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd6b97556-af3e-4805-9138-9368b77fb7e4'}, 'oper': 'CREATE', 'request-id': 'req-5aef7501-1a6a-41d6-9923-2f58b93d9e7d', 'type': 'overlay_role', 'uuid': 'd6b97556-af3e-4805-9138-9368b77fb7e4'} 10/21/2024 02:02:05.705 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-mcast-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:crb-mcast-gateway 10/21/2024 02:02:05.705 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:crb-mcast-gateway 10/21/2024 02:02:05.712 7fcafef0b780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.712 7fcafef0b780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.734 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'obj_dict': {'display_name': 'crb-mcast-gateway', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'id_perms': {'created': '2024-10-21T02:02:05.726385', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.726385', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11557393339520337261, 'uuid_mslong': 17609810271186405752}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f4629d24-1017-4978-a064-1c023393456d'}, 'oper': 'CREATE', 'request-id': 'req-818a820c-f106-4567-8a1e-5023695618f4', 'type': 'overlay_role', 'uuid': 'f4629d24-1017-4978-a064-1c023393456d'} 10/21/2024 02:02:05.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:05.841 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:crb-gateway 10/21/2024 02:02:05.842 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:crb-gateway 10/21/2024 02:02:05.852 7fcaff013eb8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 10/21/2024 02:02:05.852 7fcaff013eb8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'security_logging_objects' 10/21/2024 02:02:05.852 7fcaff013eb8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 10/21/2024 02:02:05.853 7fcaff013eb8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:05.853 7fcaff013eb8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 10/21/2024 02:02:05.854 7fcaff013eb8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'application_policy_set_back_refs' 10/21/2024 02:02:05.862 7fcaff6b8780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.863 7fcaff6b8780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.916 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'obj_dict': {'display_name': 'crb-gateway', 'fq_name': ['default-global-system-config', 'crb-gateway'], 'id_perms': {'created': '2024-10-21T02:02:05.888731', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:05.888731', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9517671406408512712, 'uuid_mslong': 5979234946871804226}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '52fa8281-3ce5-4142-8415-8fb7a3df34c8'}, 'oper': 'CREATE', 'request-id': 'req-79c8c3f9-934d-4f7d-b8f6-35fb20ce5885', 'type': 'overlay_role', 'uuid': '52fa8281-3ce5-4142-8415-8fb7a3df34c8'} 10/21/2024 02:02:05.980 7fcb0a88aeb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d79c093b-654c-4581-b879-8f6d131b2fd5 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.30:8082/global-vrouter-config/d79c093b-654c-4581-b879-8f6d131b2fd5 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "d79c093b-654c-4581-b879-8f6d131b2fd5", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["127.0.0.1"]}]}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:05.981 7fcb0a88aeb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d79c093b-654c-4581-b879-8f6d131b2fd5 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.30:8082/global-vrouter-config/d79c093b-654c-4581-b879-8f6d131b2fd5 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_linklocal.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "d79c093b-654c-4581-b879-8f6d131b2fd5", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "linklocal_services": {"linklocal_service_entry": [{"linklocal_service_name": "metadata", "linklocal_service_ip": "169.254.169.254", "linklocal_service_port": 80, "ip_fabric_DNS_service_name": "", "ip_fabric_service_port": 8775, "ip_fabric_service_ip": ["127.0.0.1"]}]}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.000 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'collapsed-spine'] not found in DB: Unknown id: overlay_role default-global-system-config:collapsed-spine 10/21/2024 02:02:06.000 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:collapsed-spine 10/21/2024 02:02:06.007 7fcafef0b780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.007 7fcafef0b780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.008 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-a2016116-27eb-423b-8330-b3d71bd818d6', 'type': 'global_vrouter_config', 'uuid': 'd79c093b-654c-4581-b879-8f6d131b2fd5'} 10/21/2024 02:02:06.046 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2024-10-21T02:02:06.034836', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:06.034836', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12836781316507196632, 'uuid_mslong': 13130297584785704190}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b6383016-0852-44fe-b225-68985dc85cd8'}, 'oper': 'CREATE', 'request-id': 'req-7a77013f-0e41-4220-9609-cabf35ae02bf', 'type': 'overlay_role', 'uuid': 'b6383016-0852-44fe-b225-68985dc85cd8'} 10/21/2024 02:02:06.153 7fcafef2dcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f4629d24-1017-4978-a064-1c023393456d object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.30:8082/overlay-role/f4629d24-1017-4978-a064-1c023393456d operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": "f4629d24-1017-4978-a064-1c023393456d", "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.153 7fcafef2dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f4629d24-1017-4978-a064-1c023393456d object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = https://10.0.0.30:8082/overlay-role/f4629d24-1017-4978-a064-1c023393456d operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": "f4629d24-1017-4978-a064-1c023393456d", "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.176 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-7e1ac07a-1541-48ad-a2f7-43e18f0d284b', 'type': 'overlay_role', 'uuid': 'f4629d24-1017-4978-a064-1c023393456d'} 10/21/2024 02:02:06.274 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:dc-gateway 10/21/2024 02:02:06.274 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:dc-gateway 10/21/2024 02:02:06.281 7fcb04015198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.283 7fcb04015198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dc-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.324 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2024-10-21T02:02:06.312369', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:06.312369', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9632889826457208284, 'uuid_mslong': 8100981528311383313}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '706c77c7-7700-4511-85ae-e6428a74c5dc'}, 'oper': 'CREATE', 'request-id': 'req-5de88a04-bd49-4556-8747-66813a0a4583', 'type': 'overlay_role', 'uuid': '706c77c7-7700-4511-85ae-e6428a74c5dc'} 10/21/2024 02:02:06.417 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dci-gateway'] not found in DB: Unknown id: overlay_role default-global-system-config:dci-gateway 10/21/2024 02:02:06.417 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:dci-gateway 10/21/2024 02:02:06.423 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dci-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.423 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:dci-gateway url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.455 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'obj_dict': {'display_name': 'dci-gateway', 'fq_name': ['default-global-system-config', 'dci-gateway'], 'id_perms': {'created': '2024-10-21T02:02:06.436647', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:06.436647', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12136097800643576542, 'uuid_mslong': 13274182793656814767}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b8375eeb-d384-4caf-a86c-14a65ec282de'}, 'oper': 'CREATE', 'request-id': 'req-ba1c4ba7-706a-4745-a476-807b7aa9eade', 'type': 'overlay_role', 'uuid': 'b8375eeb-d384-4caf-a86c-14a65ec282de'} 10/21/2024 02:02:06.561 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client'] not found in DB: Unknown id: overlay_role default-global-system-config:ar-client 10/21/2024 02:02:06.562 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:ar-client 10/21/2024 02:02:06.574 7fcafef58ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-client url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.575 7fcafef58ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-client url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.625 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'obj_dict': {'display_name': 'ar-client', 'fq_name': ['default-global-system-config', 'ar-client'], 'id_perms': {'created': '2024-10-21T02:02:06.602327', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:06.602327', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9555916668765647685, 'uuid_mslong': 7737614608021997485}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6b61877d-8806-47ad-849d-6f94b102b345'}, 'oper': 'CREATE', 'request-id': 'req-d9ac6bac-d69e-49d8-bda1-bb5200f26fcd', 'type': 'overlay_role', 'uuid': '6b61877d-8806-47ad-849d-6f94b102b345'} 10/21/2024 02:02:06.719 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-replicator'] not found in DB: Unknown id: overlay_role default-global-system-config:ar-replicator 10/21/2024 02:02:06.720 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:ar-replicator 10/21/2024 02:02:06.728 7fcafee7f780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-replicator url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.728 7fcafee7f780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-replicator url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.790 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'obj_dict': {'display_name': 'ar-replicator', 'fq_name': ['default-global-system-config', 'ar-replicator'], 'id_perms': {'created': '2024-10-21T02:02:06.762236', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:06.762236', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13389687606932171879, 'uuid_mslong': 7790974040124573641}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6c1f199c-73ea-47c9-b9d1-b9efd8a46c67'}, 'oper': 'CREATE', 'request-id': 'req-6cd1f009-273c-4363-bf7c-c8710d08d3ee', 'type': 'overlay_role', 'uuid': '6c1f199c-73ea-47c9-b9d1-b9efd8a46c67'} 10/21/2024 02:02:06.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:06.893 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'route-reflector'] not found in DB: Unknown id: overlay_role default-global-system-config:route-reflector 10/21/2024 02:02:06.893 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:route-reflector 10/21/2024 02:02:06.902 7fcaff00be10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:route-reflector url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "route-reflector"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "route-reflector"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.902 7fcaff00be10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:route-reflector url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "route-reflector"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "route-reflector"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:06.938 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'obj_dict': {'display_name': 'route-reflector', 'fq_name': ['default-global-system-config', 'route-reflector'], 'id_perms': {'created': '2024-10-21T02:02:06.927409', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:06.927409', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12595806355492749911, 'uuid_mslong': 3837978043702201673}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '35433cb2-3e9e-4d49-aecd-4b2516c0c257'}, 'oper': 'CREATE', 'request-id': 'req-ee95bb70-2dcd-49dd-9248-8457ddd10cd6', 'type': 'overlay_role', 'uuid': '35433cb2-3e9e-4d49-aecd-4b2516c0c257'} 10/21/2024 02:02:07.036 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'lean'] not found in DB: Unknown id: overlay_role default-global-system-config:lean 10/21/2024 02:02:07.037 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:lean 10/21/2024 02:02:07.042 7fcb0b009eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:lean url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "lean"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.042 7fcb0b009eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:lean url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "lean"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.068 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'obj_dict': {'display_name': 'lean', 'fq_name': ['default-global-system-config', 'lean'], 'id_perms': {'created': '2024-10-21T02:02:07.058224', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:07.058224', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10286219917048768070, 'uuid_mslong': 490211135268081387}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '06cd946e-2698-4eeb-8ebf-fe840d3d6646'}, 'oper': 'CREATE', 'request-id': 'req-c11e1c50-7395-4520-9d57-809c5794e798', 'type': 'overlay_role', 'uuid': '06cd946e-2698-4eeb-8ebf-fe840d3d6646'} 10/21/2024 02:02:07.161 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-conf-elements-inconsistency'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-conf-elements-inconsistency 10/21/2024 02:02:07.162 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-conf-elements-inconsistency 10/21/2024 02:02:07.172 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain'] not found in DB: Unknown id: overlay_role default-global-system-config:pnf-servicechain 10/21/2024 02:02:07.172 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: overlay_role default-global-system-config:pnf-servicechain 10/21/2024 02:02:07.176 7fcafee7f630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.176 7fcafee7f630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.181 7fcb04015198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:pnf-servicechain url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.181 7fcb04015198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:pnf-servicechain url = https://10.0.0.30:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.219 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2024-10-21T02:02:07.197457', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.197457', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12859447931657019721, 'uuid_mslong': 3436308144335701684}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2fb0380d-09e9-46b4-b275-efc2f60c6149', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f70657ea-4b32-4a43-8d1f-24c9b800ff58', 'type': 'alarm', 'uuid': '2fb0380d-09e9-46b4-b275-efc2f60c6149'} 10/21/2024 02:02:07.222 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'obj_dict': {'display_name': 'pnf-servicechain', 'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'id_perms': {'created': '2024-10-21T02:02:07.198696', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:07.198696', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11950102046957708892, 'uuid_mslong': 13930884703202331937}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c15471d4-1d4c-4d21-a5d7-4a7f5295265c'}, 'oper': 'CREATE', 'request-id': 'req-91010cf7-9625-4248-a257-e33967777b72', 'type': 'overlay_role', 'uuid': 'c15471d4-1d4c-4d21-a5d7-4a7f5295265c'} 10/21/2024 02:02:07.236 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-address-mismatch-compute'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-address-mismatch-compute 10/21/2024 02:02:07.236 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-address-mismatch-compute 10/21/2024 02:02:07.243 7fcaff060978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.243 7fcaff060978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.269 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2024-10-21T02:02:07.253365', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.253365', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11159470937654873990, 'uuid_mslong': 171831820272812641}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '02627821-5078-4261-9ade-67b14036cf86', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ec7b9717-df64-454e-9d3b-bd835f53bafe', 'type': 'alarm', 'uuid': '02627821-5078-4261-9ade-67b14036cf86'} 10/21/2024 02:02:07.317 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-address-mismatch-control'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-address-mismatch-control 10/21/2024 02:02:07.317 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-address-mismatch-control 10/21/2024 02:02:07.318 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'erb-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:erb-leaf 10/21/2024 02:02:07.319 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:erb-leaf 10/21/2024 02:02:07.328 7fcafee5c240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.328 7fcafee5c240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.330 7fcafef4ba20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.330 7fcafef4ba20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "erb-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.371 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2024-10-21T02:02:07.343076', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.343076', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9601879647344541239, 'uuid_mslong': 2708177239141335884}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '259560d9-b7d1-434c-8540-baaa94063e37', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-cb64941a-bd5c-4a02-bb56-aa00111c4783', 'type': 'alarm', 'uuid': '259560d9-b7d1-434c-8540-baaa94063e37'} 10/21/2024 02:02:07.378 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'obj_dict': {'display_name': 'erb-leaf', 'fq_name': ['default-global-system-config', 'erb-leaf'], 'id_perms': {'created': '2024-10-21T02:02:07.343937', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:07.343937', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9418336765166850880, 'uuid_mslong': 18254969243147717943}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'}, 'oper': 'CREATE', 'request-id': 'req-b197acfb-849f-4ba3-9538-380a850e8991', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:07.409 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-bgp-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-bgp-connectivity 10/21/2024 02:02:07.409 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-bgp-connectivity 10/21/2024 02:02:07.424 7fcafee5cf60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.424 7fcafee5cf60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.450 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2024-10-21T02:02:07.436543', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.436543', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10719977199961529021, 'uuid_mslong': 18182179043484583352}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fc541381-b973-45b8-94c5-02776bfe5abd', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-2e6bd6b1-39cd-4220-9ba0-0be0af01dc77', 'type': 'alarm', 'uuid': 'fc541381-b973-45b8-94c5-02776bfe5abd'} 10/21/2024 02:02:07.476 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-access-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:crb-access-leaf 10/21/2024 02:02:07.477 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:crb-access-leaf 10/21/2024 02:02:07.483 7fcafefe1048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.483 7fcafefe1048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.493 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-conf-incorrect'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-conf-incorrect 10/21/2024 02:02:07.493 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-conf-incorrect 10/21/2024 02:02:07.501 7fcafee9f438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.502 7fcafee9f438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.513 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'obj_dict': {'display_name': 'crb-access-leaf', 'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'id_perms': {'created': '2024-10-21T02:02:07.502861', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:07.502861', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9758626281095214295, 'uuid_mslong': 6674484779747197391}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'}, 'oper': 'CREATE', 'request-id': 'req-2158b41b-b4b4-4de6-81ec-130fe7380ced', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:07.541 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2024-10-21T02:02:07.531582', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.531582', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11100638612800000287, 'uuid_mslong': 10402711488381799273}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '905ddafb-95df-4b69-9a0d-64012fedd11f', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-d1ebd5a7-98a6-4390-9aef-3a65499d2dff', 'type': 'alarm', 'uuid': '905ddafb-95df-4b69-9a0d-64012fedd11f'} 10/21/2024 02:02:07.584 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-disk-usage-high'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-disk-usage-high 10/21/2024 02:02:07.585 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-disk-usage-high 10/21/2024 02:02:07.590 7fcaff056780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.590 7fcaff056780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.612 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-access-spine'] not found in DB: Unknown id: role_definition default-global-system-config:crb-access-spine 10/21/2024 02:02:07.612 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:crb-access-spine 10/21/2024 02:02:07.619 7fcafee26240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.619 7fcafee26240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.627 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2024-10-21T02:02:07.603486', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.603486', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11826031864833823442, 'uuid_mslong': 8037802546984599567}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6f8c02d4-93bf-400f-a41e-8152f5ded2d2', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-930e96f4-0167-4467-9c83-95ee0527f5c7', 'type': 'alarm', 'uuid': '6f8c02d4-93bf-400f-a41e-8152f5ded2d2'} 10/21/2024 02:02:07.667 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'obj_dict': {'display_name': 'crb-access-spine', 'fq_name': ['default-global-system-config', 'crb-access-spine'], 'id_perms': {'created': '2024-10-21T02:02:07.647667', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:07.647667', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13832920806886062901, 'uuid_mslong': 12564578677592507627}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'}, 'oper': 'CREATE', 'request-id': 'req-654f608b-47d6-4cfe-8896-bd44a883b1b2', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:07.672 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-disk-usage-critical'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-disk-usage-critical 10/21/2024 02:02:07.673 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-disk-usage-critical 10/21/2024 02:02:07.688 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.689 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.729 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2024-10-21T02:02:07.720927', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2024-10-21T02:02:07.720927', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12682817586286412718, 'uuid_mslong': 8340212713922185216}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '73be6346-6487-4800-b002-6b65f5adc3ae', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-687e1775-fadb-4fed-bdd1-14fd1f0180a0', 'type': 'alarm', 'uuid': '73be6346-6487-4800-b002-6b65f5adc3ae'} 10/21/2024 02:02:07.772 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:crb-gateway-spine 10/21/2024 02:02:07.773 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:crb-gateway-spine 10/21/2024 02:02:07.774 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-node-status'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-node-status 10/21/2024 02:02:07.774 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-node-status 10/21/2024 02:02:07.778 7fcafefdfe10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.778 7fcafefdfe10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.779 7fcafee25f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.780 7fcafee25f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:07.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:08.023 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'obj_dict': {'display_name': 'crb-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'id_perms': {'created': '2024-10-21T02:02:08.005814', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.005814', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10289497081146780068, 'uuid_mslong': 1835247337048459413}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'}, 'oper': 'CREATE', 'request-id': 'req-ee68d387-55ab-4b31-9aa5-8ce297cfd238', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:08.058 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2024-10-21T02:02:08.038646', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.038646', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9336168152760598821, 'uuid_mslong': 992071833038571440}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0dc48c13-6fef-47b0-8190-bb78449c4125', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-35962279-b66b-4b87-a102-98cb69c8609e', 'type': 'alarm', 'uuid': '0dc48c13-6fef-47b0-8190-bb78449c4125'} 10/21/2024 02:02:08.104 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-partial-sysinfo'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-partial-sysinfo 10/21/2024 02:02:08.105 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-partial-sysinfo 10/21/2024 02:02:08.111 7fcafee13eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.111 7fcafee13eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.123 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-mcast-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:crb-mcast-gateway-spine 10/21/2024 02:02:08.123 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:crb-mcast-gateway-spine 10/21/2024 02:02:08.135 7fcafef08f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.135 7fcafef08f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.140 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2024-10-21T02:02:08.133197', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.133197', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10616678645652623444, 'uuid_mslong': 13153866501233593586}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b68bebe4-04f0-4cf2-9356-04fa88999054', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-40640fb7-eac3-4564-9001-6a450086a224', 'type': 'alarm', 'uuid': 'b68bebe4-04f0-4cf2-9356-04fa88999054'} 10/21/2024 02:02:08.159 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'obj_dict': {'display_name': 'crb-mcast-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'id_perms': {'created': '2024-10-21T02:02:08.149938', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.149938', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10867346785817168704, 'uuid_mslong': 1966456324565125246}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'}, 'oper': 'CREATE', 'request-id': 'req-b8f2f5b5-2c5a-4f6c-8efd-9847ed0bbeb3', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:08.189 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-process-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-process-connectivity 10/21/2024 02:02:08.190 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-process-connectivity 10/21/2024 02:02:08.196 7fcafef9ca20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.196 7fcafef9ca20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.236 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2024-10-21T02:02:08.215538', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.215538', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11849172710958255754, 'uuid_mslong': 1742538262018608161}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '182ebd51-2325-4c21-a470-b7cd0eeb4e8a', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ea3d74c3-fed0-4205-a01f-ad484ec173df', 'type': 'alarm', 'uuid': '182ebd51-2325-4c21-a470-b7cd0eeb4e8a'} 10/21/2024 02:02:08.258 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'collapsed-spine'] not found in DB: Unknown id: role_definition default-global-system-config:collapsed-spine 10/21/2024 02:02:08.258 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:collapsed-spine 10/21/2024 02:02:08.265 7fcafee3fb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.265 7fcafee3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "collapsed-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "collapsed-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.278 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-process-status'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-process-status 10/21/2024 02:02:08.279 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-process-status 10/21/2024 02:02:08.284 7fcafee4ecc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.284 7fcafee4ecc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.296 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2024-10-21T02:02:08.285684', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.285684', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11287045396260359548, 'uuid_mslong': 4180626696816118048}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'}, 'oper': 'CREATE', 'request-id': 'req-2fa7c6de-a56f-49e6-83dd-e5b640b8e68d', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:08.323 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2024-10-21T02:02:08.305736', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.305736', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10780617813199542311, 'uuid_mslong': 6141894512385540237}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '553c6484-92a9-408d-959c-72c86f01d827', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-56872b71-97f1-4a13-a734-afb3325b0e7e', 'type': 'alarm', 'uuid': '553c6484-92a9-408d-959c-72c86f01d827'} 10/21/2024 02:02:08.380 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-prouter-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-prouter-connectivity 10/21/2024 02:02:08.380 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-prouter-connectivity 10/21/2024 02:02:08.386 7fcafefbeeb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.386 7fcafefbeeb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.396 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:dc-gateway-spine 10/21/2024 02:02:08.396 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:dc-gateway-spine 10/21/2024 02:02:08.401 7fcaff0214e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.401 7fcaff0214e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.416 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2024-10-21T02:02:08.402532', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2024-10-21T02:02:08.402532', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9307117656606300523, 'uuid_mslong': 10009544946676615440}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8ae90c18-9df7-4910-8129-86328cc8d96b', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-84f6c4e5-b7e5-43e7-93a9-c8c6621054e5', 'type': 'alarm', 'uuid': '8ae90c18-9df7-4910-8129-86328cc8d96b'} 10/21/2024 02:02:08.431 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'obj_dict': {'display_name': 'dc-gateway-spine', 'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'id_perms': {'created': '2024-10-21T02:02:08.422843', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.422843', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11961540311414246931, 'uuid_mslong': 10530771165203154638}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'}, 'oper': 'CREATE', 'request-id': 'req-d08fbd29-3f61-4d61-8cb5-fcd80ceb7ab6', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:08.455 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-prouter-tsn-connectivity 10/21/2024 02:02:08.456 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-prouter-tsn-connectivity 10/21/2024 02:02:08.465 7fcafee3fc18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.465 7fcafee3fc18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.531 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dci-gateway-spine'] not found in DB: Unknown id: role_definition default-global-system-config:dci-gateway-spine 10/21/2024 02:02:08.532 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:dci-gateway-spine 10/21/2024 02:02:08.538 7fcafedeaa20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.538 7fcafedeaa20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.543 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2024-10-21T02:02:08.487627', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2024-10-21T02:02:08.487627', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12565360136887100757, 'uuid_mslong': 18159710310218877266}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fc044050-1898-4952-ae61-20786a026555', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-00b8686e-5600-453e-b18c-e3472b25b6f3', 'type': 'alarm', 'uuid': 'fc044050-1898-4952-ae61-20786a026555'} 10/21/2024 02:02:08.563 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'obj_dict': {'display_name': 'dci-gateway-spine', 'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'id_perms': {'created': '2024-10-21T02:02:08.556055', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.556055', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11423200725430153832, 'uuid_mslong': 13261848628521159631}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'}, 'oper': 'CREATE', 'request-id': 'req-d314a351-ac81-4792-a762-9015d4d160ad', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:08.584 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-storage-cluster-state'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-storage-cluster-state 10/21/2024 02:02:08.585 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-storage-cluster-state 10/21/2024 02:02:08.591 7fcafefbe8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.591 7fcafefbe8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.612 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2024-10-21T02:02:08.602732', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.602732', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12073703183450673694, 'uuid_mslong': 6005440756485341511}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '53579c8c-c1f6-4147-a78e-69137d14921e', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-5a3bc3da-9a63-42a7-8e32-b0a964d234f4', 'type': 'alarm', 'uuid': '53579c8c-c1f6-4147-a78e-69137d14921e'} 10/21/2024 02:02:08.657 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-interface'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-interface 10/21/2024 02:02:08.657 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-vrouter-interface 10/21/2024 02:02:08.658 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:crb-gateway-leaf 10/21/2024 02:02:08.659 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:crb-gateway-leaf 10/21/2024 02:02:08.667 7fcafede8588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.667 7fcafede8588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.668 7fcaff6b8780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.669 7fcaff6b8780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.688 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2024-10-21T02:02:08.679423', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.679423', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10191205802431744508, 'uuid_mslong': 192957808443345753}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '02ad861a-bce7-4b59-8d6e-6fae96d809fc', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-09d90626-d251-4b11-84ef-5774e4060549', 'type': 'alarm', 'uuid': '02ad861a-bce7-4b59-8d6e-6fae96d809fc'} 10/21/2024 02:02:08.692 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'obj_dict': {'display_name': 'crb-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'id_perms': {'created': '2024-10-21T02:02:08.680362', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.680362', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13486424865936577908, 'uuid_mslong': 2623974732155341265}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'}, 'oper': 'CREATE', 'request-id': 'req-635924b6-4207-4f7c-b021-41fa8ecf63e9', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:08.734 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-xmpp-connectivity'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-xmpp-connectivity 10/21/2024 02:02:08.735 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-xmpp-connectivity 10/21/2024 02:02:08.740 7fcafef08a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.740 7fcafef08a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.756 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2024-10-21T02:02:08.749368', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.749368', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9322414562725008724, 'uuid_mslong': 4155016383593203660}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '39a99562-fc00-47cc-815f-dea70c271554', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-a52e8660-7387-4642-9743-de74fff28cee', 'type': 'alarm', 'uuid': '39a99562-fc00-47cc-815f-dea70c271554'} 10/21/2024 02:02:08.787 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'crb-mcast-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:crb-mcast-gateway-leaf 10/21/2024 02:02:08.788 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:crb-mcast-gateway-leaf 10/21/2024 02:02:08.792 7fcaff064cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.793 7fcaff064cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.799 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-xmpp-close-reason'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-xmpp-close-reason 10/21/2024 02:02:08.799 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-xmpp-close-reason 10/21/2024 02:02:08.804 7fcafef2dcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.804 7fcafef2dcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.818 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'obj_dict': {'display_name': 'crb-mcast-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'id_perms': {'created': '2024-10-21T02:02:08.807095', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.807095', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9711778991804328780, 'uuid_mslong': 4909728648078511755}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'}, 'oper': 'CREATE', 'request-id': 'req-10e96c69-1af0-42ad-bd4f-74391fb60aca', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:08.831 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2024-10-21T02:02:08.816376', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2024-10-21T02:02:08.816376', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11796307977487164286, 'uuid_mslong': 16486019892495728932}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e4ca1bbe-dc3b-4124-a3b4-e79b233aa37e', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-f2d08f1c-69ff-4dae-bd7a-8b140140fc7f', 'type': 'alarm', 'uuid': 'e4ca1bbe-dc3b-4124-a3b4-e79b233aa37e'} 10/21/2024 02:02:08.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:08.875 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-core-files'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-core-files 10/21/2024 02:02:08.876 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-core-files 10/21/2024 02:02:08.882 7fcafee7f2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.882 7fcafee7f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.912 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2024-10-21T02:02:08.897389', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.897389', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12458482145493204093, 'uuid_mslong': 17617528063736103454}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f47e086e-ab77-421e-ace5-6b80e2ab3c7d', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3908b3d6-2abd-4b9a-8dbc-26dfb6a69960', 'type': 'alarm', 'uuid': 'f47e086e-ab77-421e-ace5-6b80e2ab3c7d'} 10/21/2024 02:02:08.921 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dc-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:dc-gateway-leaf 10/21/2024 02:02:08.921 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:dc-gateway-leaf 10/21/2024 02:02:08.927 7fcaff0c84e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.927 7fcaff0c84e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.944 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'obj_dict': {'display_name': 'dc-gateway-leaf', 'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'id_perms': {'created': '2024-10-21T02:02:08.938453', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:08.938453', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11542561309155943059, 'uuid_mslong': 6423947891104239538}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'}, 'oper': 'CREATE', 'request-id': 'req-91aeec31-5d7b-40b2-af03-de7431e51086', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:08.952 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-pending-cassandra-compaction-tasks 10/21/2024 02:02:08.952 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-pending-cassandra-compaction-tasks 10/21/2024 02:02:08.957 7fcafeee2b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.958 7fcafeee2b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:08.976 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2024-10-21T02:02:08.968688', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2024-10-21T02:02:08.968688', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12643287653096903958, 'uuid_mslong': 16013416088286020512}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'de3b1516-eed0-43a0-af75-fb222bec5516', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-26c2802a-54b1-4c28-8d1d-bf3b5cc32fcd', 'type': 'alarm', 'uuid': 'de3b1516-eed0-43a0-af75-fb222bec5516'} 10/21/2024 02:02:09.020 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-package-version-mismatch'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-package-version-mismatch 10/21/2024 02:02:09.020 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-package-version-mismatch 10/21/2024 02:02:09.025 7fcaff064e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.025 7fcaff064e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.038 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'dci-gateway-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:dci-gateway-leaf 10/21/2024 02:02:09.039 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:dci-gateway-leaf 10/21/2024 02:02:09.053 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2024-10-21T02:02:09.034108', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2024-10-21T02:02:09.034108', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13654100779569606685, 'uuid_mslong': 1072764570309117525}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0ee339b1-64e6-4655-bd7d-1c5105a1701d', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-05e6018f-cf6b-4b59-a2b8-34a5347c2897', 'type': 'alarm', 'uuid': '0ee339b1-64e6-4655-bd7d-1c5105a1701d'} 10/21/2024 02:02:09.055 7fcafeeeec18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.055 7fcafeeeec18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.078 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'obj_dict': {'display_name': 'dci-gateway-leaf', 'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'id_perms': {'created': '2024-10-21T02:02:09.070898', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.070898', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11677092508668364802, 'uuid_mslong': 146138211223424106}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'}, 'oper': 'CREATE', 'request-id': 'req-341d84a5-669b-441d-8d27-72ba09b172d9', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:09.090 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-limit-exceeded 10/21/2024 02:02:09.090 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-vrouter-limit-exceeded 10/21/2024 02:02:09.096 7fcafedea630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.097 7fcafedea630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.123 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2024-10-21T02:02:09.111183', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2024-10-21T02:02:09.111183', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12740471767116010379, 'uuid_mslong': 15558406102257517473}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd7ea8feb-0454-43a1-b0cf-3f91fdd7d38b', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-86478db3-a80c-42e1-9b85-8e0833d7784e', 'type': 'alarm', 'uuid': 'd7ea8feb-0454-43a1-b0cf-3f91fdd7d38b'} 10/21/2024 02:02:09.169 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-table-limit-exceeded 10/21/2024 02:02:09.170 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-vrouter-table-limit-exceeded 10/21/2024 02:02:09.176 7fcaff0d38d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.177 7fcaff0d38d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.187 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:ar-client-leaf 10/21/2024 02:02:09.187 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:ar-client-leaf 10/21/2024 02:02:09.192 7fcafefbeeb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.192 7fcafefbeeb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.202 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2024-10-21T02:02:09.190627', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2024-10-21T02:02:09.190627', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9617008872627709373, 'uuid_mslong': 7282942603979279969}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '651235b6-2dbe-4e61-8576-7a9dd6c125bd', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-89d20e20-a961-45be-b81f-c35bbb2ef5bb', 'type': 'alarm', 'uuid': '651235b6-2dbe-4e61-8576-7a9dd6c125bd'} 10/21/2024 02:02:09.224 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'obj_dict': {'display_name': 'ar-client-leaf', 'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'id_perms': {'created': '2024-10-21T02:02:09.214326', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.214326', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11791044342959215909, 'uuid_mslong': 354759603066586716}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'}, 'oper': 'CREATE', 'request-id': 'req-49b90dae-93fe-4416-bfe2-786c469562e9', 'type': 'role_definition', 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'} 10/21/2024 02:02:09.243 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'] not found in DB: Unknown id: alarm default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down 10/21/2024 02:02:09.244 7fcaff017d68 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: alarm default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down 10/21/2024 02:02:09.248 7fcafeef9630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.248 7fcafeef9630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = https://10.0.0.30:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.30 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.278 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2024-10-21T02:02:09.261109', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2024-10-21T02:02:09.261109', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9975969901703799954, 'uuid_mslong': 10829028474373161661}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '96487005-d59a-42bd-8a71-c3c5490b2492', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-d950d178-44bb-47f9-889f-203d1b81fa88', 'type': 'alarm', 'uuid': '96487005-d59a-42bd-8a71-c3c5490b2492'} 10/21/2024 02:02:09.323 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-spine'] not found in DB: Unknown id: role_definition default-global-system-config:ar-client-spine 10/21/2024 02:02:09.323 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:ar-client-spine 10/21/2024 02:02:09.327 7fcafed9f0f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.327 7fcafed9f0f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.353 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'obj_dict': {'display_name': 'ar-client-spine', 'fq_name': ['default-global-system-config', 'ar-client-spine'], 'id_perms': {'created': '2024-10-21T02:02:09.340590', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.340590', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12465244533563867421, 'uuid_mslong': 12125533588739279774}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'}, 'oper': 'CREATE', 'request-id': 'req-4222d4bb-ba13-4570-a14f-82d7dd2aa773', 'type': 'role_definition', 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'} 10/21/2024 02:02:09.443 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-replicator-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:ar-replicator-leaf 10/21/2024 02:02:09.444 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:ar-replicator-leaf 10/21/2024 02:02:09.448 7fcafedb1048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.448 7fcafedb1048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.494 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'obj_dict': {'display_name': 'ar-replicator-leaf', 'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'id_perms': {'created': '2024-10-21T02:02:09.458758', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.458758', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9521455784882019447, 'uuid_mslong': 6488471756202332026}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'}, 'oper': 'CREATE', 'request-id': 'req-0af86c6c-b3d4-4770-ba7c-cc14c4ebaf01', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:09.569 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-replicator-spine'] not found in DB: Unknown id: role_definition default-global-system-config:ar-replicator-spine 10/21/2024 02:02:09.569 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:ar-replicator-spine 10/21/2024 02:02:09.574 7fcafeda3d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.575 7fcafeda3d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-replicator-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-replicator-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.600 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'obj_dict': {'display_name': 'ar-replicator-spine', 'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'id_perms': {'created': '2024-10-21T02:02:09.588814', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.588814', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9431447939676137343, 'uuid_mslong': 16858254681560010558}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'}, 'oper': 'CREATE', 'request-id': 'req-f1c1dd01-c2c4-4798-9cb6-7728432385f2', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:09.700 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rr-spine'] not found in DB: Unknown id: role_definition default-global-system-config:rr-spine 10/21/2024 02:02:09.700 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:rr-spine 10/21/2024 02:02:09.705 7fcafedb6ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.705 7fcafedb6ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.723 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'obj_dict': {'display_name': 'rr-spine', 'fq_name': ['default-global-system-config', 'rr-spine'], 'id_perms': {'created': '2024-10-21T02:02:09.715595', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.715595', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11376461736563987736, 'uuid_mslong': 11032038849403570052}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'}, 'oper': 'CREATE', 'request-id': 'req-078dfe38-ecb4-454d-bbbd-fb1c4b1c10ad', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:09.763 7fcafefb0d68 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:09.763 7fcafefb0d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:09.763 7fcafefb0d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:09.764 7fcafefb0d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:09.764 7fcafefb0d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:09.764 7fcafefb0d68 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:09.764 7fcafefb0d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:09.764 7fcafefb0d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.765 7fcafefb0d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:09.765 7fcafefb0d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.765 7fcafefb0d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.765 7fcafefb0d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:09.765 7fcafefb0d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:09.824 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rr-superspine'] not found in DB: Unknown id: role_definition default-global-system-config:rr-superspine 10/21/2024 02:02:09.825 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:rr-superspine 10/21/2024 02:02:09.829 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-superspine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:09.864 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'obj_dict': {'display_name': 'rr-superspine', 'fq_name': ['default-global-system-config', 'rr-superspine'], 'id_perms': {'created': '2024-10-21T02:02:09.840031', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.840031', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9596688725557168101, 'uuid_mslong': 12889748053577845458}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'}, 'oper': 'CREATE', 'request-id': 'req-4b47f168-ea99-4c13-b343-429e4af672eb', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:09.968 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'rr-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:rr-leaf 10/21/2024 02:02:09.968 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:rr-leaf 10/21/2024 02:02:09.973 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:09.991 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'obj_dict': {'display_name': 'rr-leaf', 'fq_name': ['default-global-system-config', 'rr-leaf'], 'id_perms': {'created': '2024-10-21T02:02:09.983238', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:09.983238', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12918828618280270866, 'uuid_mslong': 6781236991924193821}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'}, 'oper': 'CREATE', 'request-id': 'req-57fdc283-63e1-48f0-b99f-61f0f44cc7b2', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:10.088 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'lean-spine'] not found in DB: Unknown id: role_definition default-global-system-config:lean-spine 10/21/2024 02:02:10.089 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:lean-spine 10/21/2024 02:02:10.094 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "lean-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.115 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'obj_dict': {'display_name': 'lean-spine', 'fq_name': ['default-global-system-config', 'lean-spine'], 'id_perms': {'created': '2024-10-21T02:02:10.104756', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.104756', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12661323928376153029, 'uuid_mslong': 291340789221379474}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'}, 'oper': 'CREATE', 'request-id': 'req-3d992347-bf10-49f0-a9bb-416d7125c8d1', 'type': 'role_definition', 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'} 10/21/2024 02:02:10.212 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'lean-superspine'] not found in DB: Unknown id: role_definition default-global-system-config:lean-superspine 10/21/2024 02:02:10.213 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:lean-superspine 10/21/2024 02:02:10.220 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "lean-superspine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean-superspine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.253 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'obj_dict': {'display_name': 'lean-superspine', 'fq_name': ['default-global-system-config', 'lean-superspine'], 'id_perms': {'created': '2024-10-21T02:02:10.235041', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.235041', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9551099387050327361, 'uuid_mslong': 4560732861030875250}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'}, 'oper': 'CREATE', 'request-id': 'req-4c2b7ee7-9e58-4a01-99d0-8e5972395d2d', 'type': 'role_definition', 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'} 10/21/2024 02:02:10.354 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain-pnf'] not found in DB: Unknown id: role_definition default-global-system-config:pnf-servicechain-pnf 10/21/2024 02:02:10.355 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:pnf-servicechain-pnf 10/21/2024 02:02:10.370 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-pnf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.419 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'obj_dict': {'display_name': 'pnf-servicechain-pnf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'id_perms': {'created': '2024-10-21T02:02:10.410264', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.410264', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10236497055223751556, 'uuid_mslong': 11816225802878405804}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a3fbaac3-3e5f-4cac-8e0f-57d620f1a384'}, 'oper': 'CREATE', 'request-id': 'req-9d24001f-4fdb-4be4-bdf2-d9b76b37bfe3', 'type': 'role_definition', 'uuid': 'a3fbaac3-3e5f-4cac-8e0f-57d620f1a384'} 10/21/2024 02:02:10.457 7fcafedbe198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d79c093b-654c-4581-b879-8f6d131b2fd5 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.30:8082/global-vrouter-config/d79c093b-654c-4581-b879-8f6d131b2fd5 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "d79c093b-654c-4581-b879-8f6d131b2fd5", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.476 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-d42885cc-dee5-455c-bc4f-5bfc7ddfaf5d', 'type': 'global_vrouter_config', 'uuid': 'd79c093b-654c-4581-b879-8f6d131b2fd5'} 10/21/2024 02:02:10.520 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain-spine'] not found in DB: Unknown id: role_definition default-global-system-config:pnf-servicechain-spine 10/21/2024 02:02:10.520 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:pnf-servicechain-spine 10/21/2024 02:02:10.530 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.551 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'obj_dict': {'display_name': 'pnf-servicechain-spine', 'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'id_perms': {'created': '2024-10-21T02:02:10.544570', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.544570', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10586154783898314146, 'uuid_mslong': 11149584072644706732}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9abb47a4-1b57-41ac-92e9-93b0278fa5a2'}, 'oper': 'CREATE', 'request-id': 'req-6f24f1df-089d-4254-afaf-ed4886801702', 'type': 'role_definition', 'uuid': '9abb47a4-1b57-41ac-92e9-93b0278fa5a2'} 10/21/2024 02:02:10.644 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'pnf-servicechain-leaf'] not found in DB: Unknown id: role_definition default-global-system-config:pnf-servicechain-leaf 10/21/2024 02:02:10.644 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_definition default-global-system-config:pnf-servicechain-leaf 10/21/2024 02:02:10.648 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.671 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'obj_dict': {'display_name': 'pnf-servicechain-leaf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'id_perms': {'created': '2024-10-21T02:02:10.659062', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.659062', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13750494041458140088, 'uuid_mslong': 8801567252454786554}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7a2572c8-8d47-45fa-bed3-917a3b3ce3b8'}, 'oper': 'CREATE', 'request-id': 'req-99678267-a1e7-40d2-8630-cd8ffab6e65f', 'type': 'role_definition', 'uuid': '7a2572c8-8d47-45fa-bed3-917a3b3ce3b8'} 10/21/2024 02:02:10.760 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'erb-leaf', 'l3-gateway'] not found in DB: Unknown id: feature_config default-global-system-config:erb-leaf:l3-gateway 10/21/2024 02:02:10.760 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature_config default-global-system-config:erb-leaf:l3-gateway 10/21/2024 02:02:10.765 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:erb-leaf:l3-gateway url = https://10.0.0.30:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "erb-leaf", "l3-gateway"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "use_gateway_ip", "value": "True"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.793 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'feature_config_additional_params': {'key_value_pair': [{'key': 'use_gateway_ip', 'value': 'True'}]}, 'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'id_perms': {'created': '2024-10-21T02:02:10.782039', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.782039', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11713565143233394271, 'uuid_mslong': 6782680641370475714}}, 'parent_type': 'role-definition', 'parent_uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5e20ec1b-6dce-4cc2-a28e-f16fc7d2f65f'}, 'oper': 'CREATE', 'request-id': 'req-e464822e-a26c-4f5f-a0bf-f5ea24df32da', 'type': 'feature_config', 'uuid': '5e20ec1b-6dce-4cc2-a28e-f16fc7d2f65f'} 10/21/2024 02:02:10.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:10.884 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'] not found in DB: Unknown id: feature_config default-global-system-config:ar-client-spine:assisted-replicator 10/21/2024 02:02:10.884 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature_config default-global-system-config:ar-client-spine:assisted-replicator 10/21/2024 02:02:10.889 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:ar-client-spine:assisted-replicator url = https://10.0.0.30:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:10.909 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'id_perms': {'created': '2024-10-21T02:02:10.902141', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:10.902141', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11174610036111504668, 'uuid_mslong': 3699134368787612750}}, 'parent_type': 'role-definition', 'parent_uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3355f71c-0c06-444e-9b14-309f49f0f51c'}, 'oper': 'CREATE', 'request-id': 'req-e9aeefac-257b-4f32-8bd0-4a5fc21440dd', 'type': 'feature_config', 'uuid': '3355f71c-0c06-444e-9b14-309f49f0f51c'} 10/21/2024 02:02:11.003 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'] not found in DB: Unknown id: feature_config default-global-system-config:ar-client-leaf:assisted-replicator 10/21/2024 02:02:11.004 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: feature_config default-global-system-config:ar-client-leaf:assisted-replicator 10/21/2024 02:02:11.008 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:ar-client-leaf:assisted-replicator url = https://10.0.0.30:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-leaf", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.026 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'id_perms': {'created': '2024-10-21T02:02:11.020394', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.020394', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9532363377676093973, 'uuid_mslong': 3320914853701895150}}, 'parent_type': 'role-definition', 'parent_uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2e164276-e838-43ee-8449-c1fcc4538a15'}, 'oper': 'CREATE', 'request-id': 'req-02b9b38a-0adf-4c0b-8836-0cf421644380', 'type': 'feature_config', 'uuid': '2e164276-e838-43ee-8449-c1fcc4538a15'} 10/21/2024 02:02:11.124 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k-lean'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5k-lean 10/21/2024 02:02:11.124 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-qfx5k-lean 10/21/2024 02:02:11.129 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5k-lean"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.159 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'obj_dict': {'display_name': 'juniper-qfx5k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'id_perms': {'created': '2024-10-21T02:02:11.140471', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.140471', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10500192665793926883, 'uuid_mslong': 4883109220882599522}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'}, 'oper': 'CREATE', 'request-id': 'req-2536432f-f7a4-4ca2-9ddb-40b72283512c', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:11.248 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5k 10/21/2024 02:02:11.248 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-qfx5k 10/21/2024 02:02:11.252 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "PNF-Servicechain", "AR-Client"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5k"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.272 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'obj_dict': {'display_name': 'juniper-qfx5k', 'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'id_perms': {'created': '2024-10-21T02:02:11.262969', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.262969', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11008304049714825096, 'uuid_mslong': 7082194854824857146}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'}, 'oper': 'CREATE', 'request-id': 'req-7ad3be36-5d04-469e-a25b-a4a32ace2879', 'type': 'node_profile', 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'} 10/21/2024 02:02:11.376 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k-lean'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx10k-lean 10/21/2024 02:02:11.377 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-qfx10k-lean 10/21/2024 02:02:11.404 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["Route-Reflector", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector", "AR-Client", "AR-Replicator"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10k-lean"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.422 7fcafef13978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_objects in resource global-vrouter-config: 'security_logging_objects' 10/21/2024 02:02:11.423 7fcafef13978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'security_logging_objects' 10/21/2024 02:02:11.423 7fcafef13978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-vrouter-config: 'tag_refs' 10/21/2024 02:02:11.424 7fcafef13978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:11.424 7fcafef13978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field application_policy_set_back_refs in resource global-vrouter-config: 'application_policy_set_back_refs' 10/21/2024 02:02:11.424 7fcafef13978 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'application_policy_set_back_refs' 10/21/2024 02:02:11.444 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'obj_dict': {'display_name': 'juniper-qfx10k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'id_perms': {'created': '2024-10-21T02:02:11.435186', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.435186', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11910145288899874821, 'uuid_mslong': 9284394415512504589}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['Route-Reflector', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '80d8cb87-b33e-490d-a549-5609a02b5005'}, 'oper': 'CREATE', 'request-id': 'req-a6301eee-429b-4aa2-8edf-93f192acdf3a', 'type': 'node_profile', 'uuid': '80d8cb87-b33e-490d-a549-5609a02b5005'} 10/21/2024 02:02:11.528 7fcafef13978 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d79c093b-654c-4581-b879-8f6d131b2fd5 object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = https://10.0.0.30:8082/global-vrouter-config/d79c093b-654c-4581-b879-8f6d131b2fd5 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.30 body = {"global-vrouter-config": {"uuid": "d79c093b-654c-4581-b879-8f6d131b2fd5", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.535 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5120'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5120 10/21/2024 02:02:11.535 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-qfx5120 10/21/2024 02:02:11.541 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-0df80e69-abfb-4b51-ab9c-33f56dc44f8e', 'type': 'global_vrouter_config', 'uuid': 'd79c093b-654c-4581-b879-8f6d131b2fd5'} 10/21/2024 02:02:11.543 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "Route-Reflector", "AR-Client", "ERB-UCAST-Gateway", "CRB-Gateway", "PNF-Servicechain"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "Route-Reflector", "PNF-Servicechain", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.569 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'obj_dict': {'display_name': 'juniper-qfx5120', 'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'id_perms': {'created': '2024-10-21T02:02:11.557991', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.557991', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10841948573338254987, 'uuid_mslong': 17203559305267529961}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector', 'AR-Client', 'ERB-UCAST-Gateway', 'CRB-Gateway', 'PNF-Servicechain']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'Route-Reflector', 'PNF-Servicechain', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b'}, 'oper': 'CREATE', 'request-id': 'req-95085cbd-a3a6-4426-bcdb-5c581f8d8651', 'type': 'node_profile', 'uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b'} 10/21/2024 02:02:11.668 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5220'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx5220 10/21/2024 02:02:11.668 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-qfx5220 10/21/2024 02:02:11.673 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.704 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'obj_dict': {'display_name': 'juniper-qfx5220', 'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'id_perms': {'created': '2024-10-21T02:02:11.683805', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.683805', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9737662185789520966, 'uuid_mslong': 770482921525364151}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0ab14e22-8b06-45b7-8723-202a66bcfc46'}, 'oper': 'CREATE', 'request-id': 'req-ab0d6077-fcf1-4db4-b0bc-a764e8fe6d2c', 'type': 'node_profile', 'uuid': '0ab14e22-8b06-45b7-8723-202a66bcfc46'} 10/21/2024 02:02:11.807 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-qfx10k 10/21/2024 02:02:11.807 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-qfx10k 10/21/2024 02:02:11.819 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator", "Collapsed-Spine"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10k"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.849 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'obj_dict': {'display_name': 'juniper-qfx10k', 'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'id_perms': {'created': '2024-10-21T02:02:11.833686', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.833686', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12916486374250144329, 'uuid_mslong': 135736595687690109}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'}, 'oper': 'CREATE', 'request-id': 'req-443420ed-0b6c-4328-9bc3-6cb04403ce9c', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:11.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:11.943 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-mx'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-mx 10/21/2024 02:02:11.944 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-mx 10/21/2024 02:02:11.949 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "DCI-Gateway", "CRB-MCAST-Gateway"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:11.983 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'obj_dict': {'display_name': 'juniper-mx', 'fq_name': ['default-global-system-config', 'juniper-mx'], 'id_perms': {'created': '2024-10-21T02:02:11.972629', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:11.972629', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9431507635783754613, 'uuid_mslong': 9032104889807225641}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'}, 'oper': 'CREATE', 'request-id': 'req-1eb52345-ec54-4727-ae95-14f3432ce572', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:12.083 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-srx'] not found in DB: Unknown id: node_profile default-global-system-config:juniper-srx 10/21/2024 02:02:12.084 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:juniper-srx 10/21/2024 02:02:12.088 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": false, "node_profile_roles": {"role_mappings": [{"physical_role": "pnf", "rb_roles": ["PNF-Servicechain"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.113 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'obj_dict': {'display_name': 'juniper-srx', 'fq_name': ['default-global-system-config', 'juniper-srx'], 'id_perms': {'created': '2024-10-21T02:02:12.100642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.100642', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10777753655757423844, 'uuid_mslong': 4029121239556440402}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': False, 'node_profile_roles': {'role_mappings': [{'physical_role': 'pnf', 'rb_roles': ['PNF-Servicechain']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'}, 'oper': 'CREATE', 'request-id': 'req-926983c6-f0ca-4c09-8a90-a22c8c5253cd', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:12.209 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'device-functional-group'] not found in DB: Unknown id: node_profile default-global-system-config:device-functional-group 10/21/2024 02:02:12.209 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: node_profile default-global-system-config:device-functional-group 10/21/2024 02:02:12.215 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:device-functional-group url = https://10.0.0.30:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "device-functional-group"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "ERB-UCAST-Gateway", "CRB-MCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "CRB-MCAST-Gateway", "DCI-Gateway", "ERB-UCAST-Gateway", "PNF-Servicechain", "AR-Client", "AR-Replicator"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "device-functional-group"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.234 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'obj_dict': {'display_name': 'device-functional-group', 'fq_name': ['default-global-system-config', 'device-functional-group'], 'id_perms': {'created': '2024-10-21T02:02:12.225988', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.225988', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12310227381334490043, 'uuid_mslong': 6695301474892269330}}, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5cea7d37-db1a-4712-aad6-b694b8babbbb'}, 'oper': 'CREATE', 'request-id': 'req-9691f000-7292-4146-96d2-0fcb3ad513d3', 'type': 'node_profile', 'uuid': '5cea7d37-db1a-4712-aad6-b694b8babbbb'} 10/21/2024 02:02:12.335 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-1'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-1 10/21/2024 02:02:12.336 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-1 10/21/2024 02:02:12.339 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-1 url = https://10.0.0.30:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-1"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.359 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'obj_dict': {'display_name': 'default-telemetry-profile-1', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'id_perms': {'created': '2024-10-21T02:02:12.348986', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.348986', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9625367996836290123, 'uuid_mslong': 15184489334239742752}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'd2ba2499-3f11-4b20-8594-2d321bd71e4b'}, 'oper': 'CREATE', 'request-id': 'req-6b8e8371-2a9f-4ae8-9d52-ed4b89922aed', 'type': 'telemetry_profile', 'uuid': 'd2ba2499-3f11-4b20-8594-2d321bd71e4b'} 10/21/2024 02:02:12.456 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-2'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-2 10/21/2024 02:02:12.456 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-2 10/21/2024 02:02:12.460 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = https://10.0.0.30:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-2"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-2"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.483 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'obj_dict': {'display_name': 'default-telemetry-profile-2', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'id_perms': {'created': '2024-10-21T02:02:12.470976', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.470976', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13695862315231097765, 'uuid_mslong': 2668118248649803339}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '25070f69-2d82-464b-be11-7a36400233a5'}, 'oper': 'CREATE', 'request-id': 'req-fb62d361-9089-4e82-b9f2-d1da894c1bb5', 'type': 'telemetry_profile', 'uuid': '25070f69-2d82-464b-be11-7a36400233a5'} 10/21/2024 02:02:12.569 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:02:12.570 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:02:12.570 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:02:12.570 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:02:12.570 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:02:12.571 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:02:12.572 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:02:12.573 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:02:12.574 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:02:12.575 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:02:12.576 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:02:12.577 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:02:12.578 7fcafed5c8d0 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:02:12.583 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-3'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-3 10/21/2024 02:02:12.584 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-3 10/21/2024 02:02:12.589 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = https://10.0.0.30:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-3"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-3"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.606 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'obj_dict': {'display_name': 'default-telemetry-profile-3', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'id_perms': {'created': '2024-10-21T02:02:12.600366', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.600366', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9333706798150762234, 'uuid_mslong': 9474803902407723336}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '837d43f3-177f-4948-8187-fce17d6cbefa'}, 'oper': 'CREATE', 'request-id': 'req-3de90a7d-8b44-4dd1-a790-23059f9260bd', 'type': 'telemetry_profile', 'uuid': '837d43f3-177f-4948-8187-fce17d6cbefa'} 10/21/2024 02:02:12.633 7fcafed5c8d0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/global-system-config/953d4841-c203-4a7e-b905-387930676988 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "953d4841-c203-4a7e-b905-387930676988", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.652 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-ec44388a-0efa-49d1-ad66-0c752535bb0f', 'type': 'global_system_config', 'uuid': '953d4841-c203-4a7e-b905-387930676988'} 10/21/2024 02:02:12.725 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-4'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-4 10/21/2024 02:02:12.725 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-4 10/21/2024 02:02:12.735 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = https://10.0.0.30:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-4"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-4"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.759 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'obj_dict': {'display_name': 'default-telemetry-profile-4', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'id_perms': {'created': '2024-10-21T02:02:12.751131', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.751131', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12792994326162848386, 'uuid_mslong': 10600442377233056204}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '931c562d-b4f9-41cc-b189-d88f38863a82'}, 'oper': 'CREATE', 'request-id': 'req-d5845254-5512-491c-b0d1-56edf344466c', 'type': 'telemetry_profile', 'uuid': '931c562d-b4f9-41cc-b189-d88f38863a82'} 10/21/2024 02:02:12.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:12.854 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-5'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-5 10/21/2024 02:02:12.854 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-5 10/21/2024 02:02:12.859 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = https://10.0.0.30:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-5"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-5"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.879 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'obj_dict': {'display_name': 'default-telemetry-profile-5', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'id_perms': {'created': '2024-10-21T02:02:12.869259', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.869259', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11132510475556620067, 'uuid_mslong': 9574467564673846355}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '84df5785-b9e2-4c53-9a7e-9f4b81de0723'}, 'oper': 'CREATE', 'request-id': 'req-ab6060d0-ee92-48da-b5a2-2c1301b7885d', 'type': 'telemetry_profile', 'uuid': '84df5785-b9e2-4c53-9a7e-9f4b81de0723'} 10/21/2024 02:02:12.972 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'default-telemetry-profile-6'] not found in DB: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-6 10/21/2024 02:02:12.972 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: telemetry_profile default-domain:default-project:default-telemetry-profile-6 10/21/2024 02:02:12.977 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = https://10.0.0.30:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-6"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-6"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:12.997 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'obj_dict': {'display_name': 'default-telemetry-profile-6', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'id_perms': {'created': '2024-10-21T02:02:12.988672', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:12.988672', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10469605963487024386, 'uuid_mslong': 3017562622513007548}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '29e08937-aa62-4bbc-914b-832747f49502'}, 'oper': 'CREATE', 'request-id': 'req-44144e0b-e04c-4440-89d6-83b5caa569d4', 'type': 'telemetry_profile', 'uuid': '29e08937-aa62-4bbc-914b-832747f49502'} 10/21/2024 02:02:13.092 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'sflow-all-interfaces'] not found in DB: Unknown id: sflow_profile default-domain:default-project:sflow-all-interfaces 10/21/2024 02:02:13.093 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: sflow_profile default-domain:default-project:sflow-all-interfaces 10/21/2024 02:02:13.098 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-all-interfaces url = https://10.0.0.30:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-all-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "all", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-all-interfaces"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.121 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'obj_dict': {'display_name': 'sflow-all-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'id_perms': {'created': '2024-10-21T02:02:13.110391', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.110391', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9927523211132824100, 'uuid_mslong': 18265871815673269859}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'all', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'fd7d69a3-be06-4e63-89c5-a5c323046a24'}, 'oper': 'CREATE', 'request-id': 'req-153b5009-73ef-42b4-80ba-0eeaa1a6ff40', 'type': 'sflow_profile', 'uuid': 'fd7d69a3-be06-4e63-89c5-a5c323046a24'} 10/21/2024 02:02:13.212 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'sflow-fabric-interfaces'] not found in DB: Unknown id: sflow_profile default-domain:default-project:sflow-fabric-interfaces 10/21/2024 02:02:13.212 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: sflow_profile default-domain:default-project:sflow-fabric-interfaces 10/21/2024 02:02:13.217 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-fabric-interfaces url = https://10.0.0.30:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "fabric", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-fabric-interfaces"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.235 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'obj_dict': {'display_name': 'sflow-fabric-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'id_perms': {'created': '2024-10-21T02:02:13.229462', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.229462', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13743535972985924971, 'uuid_mslong': 13490014992977445006}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'fabric', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'bb362929-b71d-408e-beba-d926aba0ed6b'}, 'oper': 'CREATE', 'request-id': 'req-353205ee-2503-4e4e-abec-7d03d8eaa314', 'type': 'sflow_profile', 'uuid': 'bb362929-b71d-408e-beba-d926aba0ed6b'} 10/21/2024 02:02:13.332 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'sflow-access-interfaces'] not found in DB: Unknown id: sflow_profile default-domain:default-project:sflow-access-interfaces 10/21/2024 02:02:13.332 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: sflow_profile default-domain:default-project:sflow-access-interfaces 10/21/2024 02:02:13.336 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-access-interfaces url = https://10.0.0.30:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-access-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "access", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-access-interfaces"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.355 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'obj_dict': {'display_name': 'sflow-access-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'id_perms': {'created': '2024-10-21T02:02:13.348183', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.348183', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10825783486450117512, 'uuid_mslong': 14728423748474651097}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'access', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'cc65df5d-5d42-41d9-963c-e8b935262b88'}, 'oper': 'CREATE', 'request-id': 'req-05bf0526-cc80-4c98-ae7e-b33ce4e1b13c', 'type': 'sflow_profile', 'uuid': 'cc65df5d-5d42-41d9-963c-e8b935262b88'} 10/21/2024 02:02:13.448 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'grpc-default-profile'] not found in DB: Unknown id: grpc_profile default-domain:default-project:grpc-default-profile 10/21/2024 02:02:13.448 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: grpc_profile default-domain:default-project:grpc-default-profile 10/21/2024 02:02:13.453 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = grpc_profile identifier_name = default-domain:default-project:grpc-default-profile url = https://10.0.0.30:8082/grpc-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"grpc-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "grpc-default-profile"], "parent_type": "project", "grpc_profile_is_default": true, "grpc_parameters": {"allow_clients": {"subnet": [{"ip_prefix": "0.0.0.0", "ip_prefix_len": 0}]}, "enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}, "secure_mode": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "grpc-default-profile"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.475 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'obj_dict': {'display_name': 'grpc-default-profile', 'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'grpc_parameters': {'allow_clients': {'subnet': [{'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}]}, 'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}, 'secure_mode': None}, 'grpc_profile_is_default': True, 'id_perms': {'created': '2024-10-21T02:02:13.464556', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.464556', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13411186014394271622, 'uuid_mslong': 9410900364684970318}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '829a3c05-45a4-494e-ba1e-1a9fe4a84786'}, 'oper': 'CREATE', 'request-id': 'req-dff087a7-92e6-4728-bf90-130460382e72', 'type': 'grpc_profile', 'uuid': '829a3c05-45a4-494e-ba1e-1a9fe4a84786'} 10/21/2024 02:02:13.572 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'snmp-default-profile'] not found in DB: Unknown id: snmp_profile default-domain:default-project:snmp-default-profile 10/21/2024 02:02:13.573 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: snmp_profile default-domain:default-project:snmp-default-profile 10/21/2024 02:02:13.579 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = snmp_profile identifier_name = default-domain:default-project:snmp-default-profile url = https://10.0.0.30:8082/snmp-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"snmp-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "snmp-default-profile"], "parent_type": "project", "snmp_profile_is_default": true, "snmp_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "snmp-default-profile"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.604 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'obj_dict': {'display_name': 'snmp-default-profile', 'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'id_perms': {'created': '2024-10-21T02:02:13.592314', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.592314', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10339592326449002747, 'uuid_mslong': 5053281230087605069}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'snmp_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'snmp_profile_is_default': True, 'uuid': '4620dc81-5d85-4b4d-8f7d-9c707c58f8fb'}, 'oper': 'CREATE', 'request-id': 'req-8f3eaf7c-15f2-443e-bb24-602d35329c7a', 'type': 'snmp_profile', 'uuid': '4620dc81-5d85-4b4d-8f7d-9c707c58f8fb'} 10/21/2024 02:02:13.696 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'netconf-default-profile'] not found in DB: Unknown id: netconf_profile default-domain:default-project:netconf-default-profile 10/21/2024 02:02:13.696 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: netconf_profile default-domain:default-project:netconf-default-profile 10/21/2024 02:02:13.701 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = netconf_profile identifier_name = default-domain:default-project:netconf-default-profile url = https://10.0.0.30:8082/netconf-profiles operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"netconf-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "netconf-default-profile"], "parent_type": "project", "netconf_profile_is_default": true, "netconf_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "netconf-default-profile"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.721 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'obj_dict': {'display_name': 'netconf-default-profile', 'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'id_perms': {'created': '2024-10-21T02:02:13.712026', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.712026', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12824955109821489171, 'uuid_mslong': 8343664417852507613}}, 'netconf_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'netconf_profile_is_default': True, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '73caa694-d72a-45dd-b1fb-64b90d3da013'}, 'oper': 'CREATE', 'request-id': 'req-dfd32935-2e03-47a4-9c3b-a813d19169df', 'type': 'netconf_profile', 'uuid': '73caa694-d72a-45dd-b1fb-64b90d3da013'} 10/21/2024 02:02:13.763 7fcaff0646d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:13.820 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L2-Server-Leaf'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L2-Server-Leaf 10/21/2024 02:02:13.820 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:L2-Server-Leaf 10/21/2024 02:02:13.825 7fcafef2a828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L2-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L2 servers connectivity with ingress replication for multicast in the spine", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Access", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L2-Server-Leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.825 7fcafef2a828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L2-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L2 servers connectivity with ingress replication for multicast in the spine", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Access", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L2-Server-Leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.842 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L2 servers ' 'connectivity with ' 'ingress replication for ' 'multicast in the spine', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Access', 'AR-Client']}, 'display_name': 'L2-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'id_perms': {'created': '2024-10-21T02:02:13.834271', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.834271', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10588927833254280085, 'uuid_mslong': 17985902871694427072}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f99ac35e-5006-43c0-92f3-6dc3055e3b95'}, 'oper': 'CREATE', 'request-id': 'req-30f60188-318e-4660-80d2-8ce1a47f8314', 'type': 'device_functional_group', 'uuid': 'f99ac35e-5006-43c0-92f3-6dc3055e3b95'} 10/21/2024 02:02:13.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:13.936 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Server-Leaf'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Server-Leaf 10/21/2024 02:02:13.936 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:L3-Server-Leaf 10/21/2024 02:02:13.940 7fcaff069e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity", "device_functional_group_os_version": "19.1R3", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.940 7fcaff069e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity", "device_functional_group_os_version": "19.1R3", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:13.955 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity', 'device_functional_group_os_version': '19.1R3', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'id_perms': {'created': '2024-10-21T02:02:13.949116', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:13.949116', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10559076930838471291, 'uuid_mslong': 8460420114896670419}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '75697344-eefc-4ed3-9289-608632a6227b'}, 'oper': 'CREATE', 'request-id': 'req-b017c602-2716-4dc1-a914-4eef8f098da7', 'type': 'device_functional_group', 'uuid': '75697344-eefc-4ed3-9289-608632a6227b'} 10/21/2024 02:02:14.056 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Gateway-Spine'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Gateway-Spine 10/21/2024 02:02:14.056 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:L3-Gateway-Spine 10/21/2024 02:02:14.061 7fcaff0d3588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Gateway-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway connectivity at spines", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Gateway-Spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.062 7fcaff0d3588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Gateway-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway connectivity at spines", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["CRB-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Gateway-Spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.078 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'connectivity at spines', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Gateway']}, 'display_name': 'L3-Gateway-Spine', 'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'id_perms': {'created': '2024-10-21T02:02:14.071296', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.071296', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13708677089948013258, 'uuid_mslong': 2200885343874205183}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1e8b1d8f-38fc-45ff-be3f-012e7ee312ca'}, 'oper': 'CREATE', 'request-id': 'req-494e26f9-a6ed-48fe-b089-39f39851b5e0', 'type': 'device_functional_group', 'uuid': '1e8b1d8f-38fc-45ff-be3f-012e7ee312ca'} 10/21/2024 02:02:14.177 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Storage-Leaf'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Storage-Leaf 10/21/2024 02:02:14.177 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:L3-Storage-Leaf 10/21/2024 02:02:14.183 7fcaff0d2780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Storage-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 connectivity to storage arrays", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Storage-Leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.183 7fcaff0d2780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Storage-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 connectivity to storage arrays", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Storage-Leaf"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.215 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 connectivity ' 'to storage arrays', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Storage-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'id_perms': {'created': '2024-10-21T02:02:14.200174', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.200174', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9775257216029039457, 'uuid_mslong': 11422201945340461354}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9e83d026-e0cb-412a-87a8-b0a57d7c1b61'}, 'oper': 'CREATE', 'request-id': 'req-9204cb14-a0f3-47f0-91f2-111fecbbf920', 'type': 'device_functional_group', 'uuid': '9e83d026-e0cb-412a-87a8-b0a57d7c1b61'} 10/21/2024 02:02:14.320 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'] not found in DB: Unknown id: device_functional_group default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast 10/21/2024 02:02:14.320 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast 10/21/2024 02:02:14.326 7fcaff056240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf-with-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity with Optimized multicast traffic", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf-with-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.326 7fcaff056240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf-with-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity with Optimized multicast traffic", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf-with-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.347 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity with ' 'Optimized multicast ' 'traffic', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway', 'AR-Client']}, 'display_name': 'L3-Server-Leaf-with-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'id_perms': {'created': '2024-10-21T02:02:14.336807', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.336807', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12135432997961317511, 'uuid_mslong': 11681022172470201651}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a21b53c6-f38c-4d33-a869-b803ef09bc87'}, 'oper': 'CREATE', 'request-id': 'req-36dc57c4-42b2-4347-af76-7ea230a0ed5d', 'type': 'device_functional_group', 'uuid': 'a21b53c6-f38c-4d33-a869-b803ef09bc87'} 10/21/2024 02:02:14.439 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Centrally-Routed-Border-Spine 10/21/2024 02:02:14.440 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:Centrally-Routed-Border-Spine 10/21/2024 02:02:14.444 7fcafee9f978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing for L2 server leafs and route reflector and ingress replication, as well DCGW and DCI GW and connectivity to firewalls", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.444 7fcafee9f978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing for L2 server leafs and route reflector and ingress replication, as well DCGW and DCI GW and connectivity to firewalls", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.459 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing ' 'for L2 server leafs and ' 'route reflector and ' 'ingress replication, as ' 'well DCGW and DCI GW and ' 'connectivity to ' 'firewalls', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'id_perms': {'created': '2024-10-21T02:02:14.452894', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.452894', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11420287959003050034, 'uuid_mslong': 13091417407947952039}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b5ae0ec5-6f1a-4fa7-9e7d-0364350c3032'}, 'oper': 'CREATE', 'request-id': 'req-3ad6f99f-f9d5-49e0-b384-b7b83fb9fedb', 'type': 'device_functional_group', 'uuid': 'b5ae0ec5-6f1a-4fa7-9e7d-0364350c3032'} 10/21/2024 02:02:14.564 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast 10/21/2024 02:02:14.564 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast 10/21/2024 02:02:14.569 7fcafefff978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine-With-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing and gateway services for L2 server leafs ; provides route reflector and assisted replication", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "AR-Replicator", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine-With-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.569 7fcafefff978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Centrally-Routed-Border-Spine-With-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 routing and gateway services for L2 server leafs ; provides route reflector and assisted replication", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "AR-Replicator", "CRB-Gateway", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Centrally-Routed-Border-Spine-With-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.587 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing and ' 'gateway services for L2 ' 'server leafs ; provides ' 'route reflector and ' 'assisted replication', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'AR-Replicator', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine-With-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'id_perms': {'created': '2024-10-21T02:02:14.580581', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.580581', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10509234396095135821, 'uuid_mslong': 7594420302213433616}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6964cd07-2472-4910-91d8-4d00c091404d'}, 'oper': 'CREATE', 'request-id': 'req-b6799494-cbaa-4d10-a033-c69560ce0361', 'type': 'device_functional_group', 'uuid': '6964cd07-2472-4910-91d8-4d00c091404d'} 10/21/2024 02:02:14.685 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Border-Spine-in-Edge-Routed 10/21/2024 02:02:14.685 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:Border-Spine-in-Edge-Routed 10/21/2024 02:02:14.690 7fcaff013438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Spine-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Spine-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.691 7fcaff013438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Spine-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Spine-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.707 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Spine-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'id_perms': {'created': '2024-10-21T02:02:14.700818', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.700818', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13238552068473948687, 'uuid_mslong': 8507525217430031397}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7610cd1c-4698-4c25-b7b8-c8f725e70a0f'}, 'oper': 'CREATE', 'request-id': 'req-3b29d1b3-79f5-4397-9cf2-a3765575bfa0', 'type': 'device_functional_group', 'uuid': '7610cd1c-4698-4c25-b7b8-c8f725e70a0f'} 10/21/2024 02:02:14.800 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Border-Leaf-in-Edge-Routed 10/21/2024 02:02:14.800 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:Border-Leaf-in-Edge-Routed 10/21/2024 02:02:14.805 7fcaff064978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Leaf-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Leaf-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.805 7fcaff064978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Leaf-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Leaf-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.822 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Leaf-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'id_perms': {'created': '2024-10-21T02:02:14.815803', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.815803', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10163330687449860082, 'uuid_mslong': 3051983617467894146}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2a5ad2ee-137c-4982-8d0b-6769a04687f2'}, 'oper': 'CREATE', 'request-id': 'req-f02d3d63-92cc-4cd0-b0e9-7f7a33ed9047', 'type': 'device_functional_group', 'uuid': '2a5ad2ee-137c-4982-8d0b-6769a04687f2'} 10/21/2024 02:02:14.854 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:14.920 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'] not found in DB: Unknown id: device_functional_group default-domain:default-project:Lean-Spine-with-Route-Reflector 10/21/2024 02:02:14.921 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: device_functional_group default-domain:default-project:Lean-Spine-with-Route-Reflector 10/21/2024 02:02:14.926 7fcaff0d3978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Lean-Spine-with-Route-Reflector"], "parent_type": "project", "device_functional_group_description": "Spine only acting as Route Reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "lean"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Lean-Spine-with-Route-Reflector"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.926 7fcaff0d3978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.30:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Lean-Spine-with-Route-Reflector"], "parent_type": "project", "device_functional_group_description": "Spine only acting as Route Reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "lean"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Lean-Spine-with-Route-Reflector"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:14.951 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'obj_dict': {'device_functional_group_description': 'Spine only acting as ' 'Route Reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'lean']}, 'display_name': 'Lean-Spine-with-Route-Reflector', 'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'id_perms': {'created': '2024-10-21T02:02:14.936843', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:14.936843', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10636386986335533465, 'uuid_mslong': 13946350662592515267}}, 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c18b6409-64dc-4cc3-939c-099c2e1df999'}, 'oper': 'CREATE', 'request-id': 'req-e40bb086-b89c-4c94-8b25-e5251eddad0f', 'type': 'device_functional_group', 'uuid': 'c18b6409-64dc-4cc3-939c-099c2e1df999'} 10/21/2024 02:02:15.049 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5k-lean:basic 10/21/2024 02:02:15.049 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-qfx5k-lean:basic 10/21/2024 02:02:15.055 7fcaff758ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k-lean:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.055 7fcaff758ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k-lean:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.097 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.071907', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.071907', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12414445987130794786, 'uuid_mslong': 15000075503915518459}}, 'parent_type': 'node-profile', 'parent_uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'd02af932-6eec-49fb-ac48-f8d9ca346322'}, 'oper': 'CREATE', 'request-id': 'req-2e1b1ab3-860f-4a98-baf8-713aa823ee30', 'type': 'role_config', 'uuid': 'd02af932-6eec-49fb-ac48-f8d9ca346322'} 10/21/2024 02:02:15.188 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5k', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5k:basic 10/21/2024 02:02:15.189 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-qfx5k:basic 10/21/2024 02:02:15.194 7fcafeea7390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.194 7fcafeea7390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.214 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.204673', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.204673', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10677482271022923086, 'uuid_mslong': 9950381507161114489}}, 'parent_type': 'node-profile', 'parent_uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '8a16db42-e9f4-4779-942e-098dc3da3d4e'}, 'oper': 'CREATE', 'request-id': 'req-30aec203-9172-4520-98a1-5627b19d606d', 'type': 'role_config', 'uuid': '8a16db42-e9f4-4779-942e-098dc3da3d4e'} 10/21/2024 02:02:15.308 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5120', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5120:basic 10/21/2024 02:02:15.308 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-qfx5120:basic 10/21/2024 02:02:15.313 7fcafef66630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5120:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.313 7fcafef66630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5120:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5120", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.329 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.323307', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.323307', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10372996088767950171, 'uuid_mslong': 171969219084697734}}, 'parent_type': 'node-profile', 'parent_uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '0262f517-f7d8-4086-8ff4-48fbf787ad5b'}, 'oper': 'CREATE', 'request-id': 'req-ecd494ba-4c7c-4448-84fe-fd57ddd80b21', 'type': 'role_config', 'uuid': '0262f517-f7d8-4086-8ff4-48fbf787ad5b'} 10/21/2024 02:02:15.424 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx5220', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx5220:basic 10/21/2024 02:02:15.424 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-qfx5220:basic 10/21/2024 02:02:15.428 7fcafefd0ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5220:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.429 7fcafefd0ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5220:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.445 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.439467', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.439467', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11305275640401998415, 'uuid_mslong': 6176753709696567081}}, 'parent_type': 'node-profile', 'parent_uuid': '0ab14e22-8b06-45b7-8723-202a66bcfc46', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '55b83cc5-eb8a-4729-9ce4-684c0a09b24f'}, 'oper': 'CREATE', 'request-id': 'req-c913fc5e-e4c2-410e-a450-0495232e41b7', 'type': 'role_config', 'uuid': '55b83cc5-eb8a-4729-9ce4-684c0a09b24f'} 10/21/2024 02:02:15.543 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx10k-lean:basic 10/21/2024 02:02:15.543 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-qfx10k-lean:basic 10/21/2024 02:02:15.547 7fcafed9f2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k-lean:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.548 7fcafed9f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k-lean:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.566 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.558079', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.558079', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11157823380298916304, 'uuid_mslong': 4457244449922500687}}, 'parent_type': 'node-profile', 'parent_uuid': '80d8cb87-b33e-490d-a549-5609a02b5005', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '3ddb5036-32b6-484f-9ad8-8d3f6943e1d0'}, 'oper': 'CREATE', 'request-id': 'req-dbdec7a7-9d18-4cef-b25d-4b7e0ffe462a', 'type': 'role_config', 'uuid': '3ddb5036-32b6-484f-9ad8-8d3f6943e1d0'} 10/21/2024 02:02:15.660 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-qfx10k', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-qfx10k:basic 10/21/2024 02:02:15.660 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-qfx10k:basic 10/21/2024 02:02:15.665 7fcaff0d3630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.666 7fcaff0d3630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx10k:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx10k", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.683 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.675188', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.675188', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11567966652062997080, 'uuid_mslong': 1013426963051463664}}, 'parent_type': 'node-profile', 'parent_uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '0e106a74-1a7c-43f0-a089-ac615dc79a58'}, 'oper': 'CREATE', 'request-id': 'req-fe0974a0-ad1f-4987-aed9-7edb689ac989', 'type': 'role_config', 'uuid': '0e106a74-1a7c-43f0-a089-ac615dc79a58'} 10/21/2024 02:02:15.776 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-mx', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-mx:basic 10/21/2024 02:02:15.776 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-mx:basic 10/21/2024 02:02:15.781 7fcafedc1b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-mx:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.781 7fcafedc1b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-mx:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.800 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.791578', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.791578', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12478655026926843388, 'uuid_mslong': 17658164990225630542}}, 'parent_type': 'node-profile', 'parent_uuid': '7d587b8b-0b07-4329-82e3-723977466375', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'f50e6780-6ba3-454e-ad2d-16a1da9df5fc'}, 'oper': 'CREATE', 'request-id': 'req-f47e7221-fe69-45c2-ac21-5ef6b4fccc89', 'type': 'role_config', 'uuid': 'f50e6780-6ba3-454e-ad2d-16a1da9df5fc'} 10/21/2024 02:02:15.855 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:15.900 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'juniper-srx', 'basic'] not found in DB: Unknown id: role_config default-global-system-config:juniper-srx:basic 10/21/2024 02:02:15.901 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: role_config default-global-system-config:juniper-srx:basic 10/21/2024 02:02:15.906 7fcafefb0eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-srx:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.907 7fcafefb0eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-srx:basic url = https://10.0.0.30:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:15.928 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'id_perms': {'created': '2024-10-21T02:02:15.918659', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:15.918659', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12679563693569284946, 'uuid_mslong': 4774479229049588963}}, 'parent_type': 'node-profile', 'parent_uuid': '37ea506b-90be-4152-9592-45d8d016c4e4', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '42425b90-02fb-4ce3-aff6-dc0006231b52'}, 'oper': 'CREATE', 'request-id': 'req-f13850b7-c714-4e5d-aea5-b4f82698b853', 'type': 'role_config', 'uuid': '42425b90-02fb-4ce3-aff6-dc0006231b52'} 10/21/2024 02:02:16.076 7fcafee5d4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.076 7fcafee5d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.088 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-93657361-d3e1-4bb7-9b67-5a7d6ded25ed', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:16.240 7fcafef74780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.240 7fcafef74780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.246 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7f6f79f1-0bdb-420d-b211-76fe06b77b3f', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:16.395 7fcafef3bd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.396 7fcafef3bd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.404 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ae7e7355-8651-4149-b03e-a0da4553be6f', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:16.560 7fcafef582e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.560 7fcafef582e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.581 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b5ebac12-7ddb-4a48-8674-182cb16399cc', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:16.730 7fcafef66c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.731 7fcafef66c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.741 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-786ed654-f597-4d2d-8582-329e5f834c2f', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:16.760 7fcafef62390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:02:16.818 7fcafef62390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:02:16.899 7fcafef0bac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.899 7fcafef0bac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:16.907 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d3b98f67-e8e8-4e0c-8427-63bc38cfd979', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:17.060 7fcaff050f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.060 7fcaff050f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.069 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b05c1790-dbb9-4eed-a958-1e21a884593e', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:17.225 7fcafedeaac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.225 7fcafedeaac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.234 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0849b35e-91c8-49e8-be2a-6db3e40d0488', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:17.383 7fcafef8f828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.383 7fcafef8f828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.393 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-44a339c3-32fd-42a0-ae47-0419175679fb', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:17.539 7fcafef47588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "overlay-role", "ref-uuid": "713c001c-6be8-4c84-b19f-f8ecebf8ef18", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.539 7fcafef47588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "overlay-role", "ref-uuid": "713c001c-6be8-4c84-b19f-f8ecebf8ef18", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.547 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5d15f994-f7c2-41fb-836e-8ba3333791e0', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:17.694 7fcafef3be10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.694 7fcafef3be10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.695 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:17.707 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6cc1e698-358b-407f-81c3-ff31fa5d1650', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:17.858 7fcafefbe630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.859 7fcafefbe630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:17.870 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b3a72126-e675-4c4a-81bf-c1c482507acf', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:18.026 7fcafef3bd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.026 7fcafef3bd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.034 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a91dd4d9-195e-4df8-8b12-c96acea17b3e', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:18.182 7fcafefbe2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.182 7fcafefbe2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.194 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3caa7413-d2ff-4407-bb21-065c8ca2a52a', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:18.345 7fcafefdfb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.345 7fcafefdfb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.354 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cd866f8c-67b3-4855-9a01-6016c967fd48', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:18.510 7fcaff1aac18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.510 7fcaff1aac18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.527 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7c7484d4-9040-4660-8590-3bf3cb28f5b0', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:18.688 7fcafee3f390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.689 7fcafee3f390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.696 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:18.719 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2b213b16-1c45-46c5-a9cd-7a40b11c4eca', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:18.768 7fcaff0646d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:18.768 7fcaff0646d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:18.769 7fcaff0646d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:18.769 7fcaff0646d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:18.769 7fcaff0646d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:18.769 7fcaff0646d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:18.770 7fcaff0646d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:18.879 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "overlay-role", "ref-uuid": "d6b97556-af3e-4805-9138-9368b77fb7e4", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:18.890 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ec7cad3e-46f5-4319-87ba-c1b7ab032421', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:19.040 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.051 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-a8823191-547d-4cf4-9f14-ddd1ab671196', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:19.193 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.210 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ebc90c82-6536-4ff8-ae79-72f2a4a05e59', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:19.362 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.371 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-05700afb-5120-4929-a8ed-833b191fb566', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:19.512 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.522 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-ce66867d-e965-410e-9760-d343dbbf2de8', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:19.665 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.674 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-637ee549-9e05-4482-b29f-f565c343f5f2', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:19.697 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:19.817 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.827 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-aa7417d9-e4d5-4f05-807a-dafa596baadb', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:19.981 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:19.997 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-b743da02-8028-40bc-a31d-847f1440723f', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:20.142 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "overlay-role", "ref-uuid": "d6b97556-af3e-4805-9138-9368b77fb7e4", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:20.150 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-34e3df39-f00a-48ba-803e-80bf7979a8f6', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:20.293 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:20.302 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-23a749f1-6d8a-4b8f-9390-0f4fdcac25d5', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:20.448 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:20.455 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-810b744f-221e-4942-96d4-cde6f9994c28', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:20.604 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:20.613 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-95f63f42-288a-4131-92d8-e4db669e59af', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:20.698 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:20.766 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:20.775 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-6b487c98-42ab-453a-811a-2c76a3c94097', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:20.932 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:20.939 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fcb10a5e-a1b4-4825-9dcb-e0445c2731da', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:21.094 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:21.112 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-de928346-b218-4d53-84d3-aea6b76b1de8', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:21.261 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "overlay-role", "ref-uuid": "52fa8281-3ce5-4142-8415-8fb7a3df34c8", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:21.271 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-eaf41473-7afa-42b8-a531-b739fcdb39d9', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:21.421 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:21.429 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2fda6dd4-37b6-45eb-a5b6-cbf2081786d4', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:21.580 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:21.641 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4826fac2-a5ee-44ee-af8c-e064cd2642b0', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:21.700 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:21.790 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:21.802 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fd972747-f14d-4c24-8d92-81bee2500af2', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:21.957 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:21.980 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-824f63bc-5ade-4935-82ae-9b33388a6e8d', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:22.132 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.140 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b540f761-7e43-48bf-9d71-8c63a50e6c77', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:22.290 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.301 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5b934447-63dc-40af-a41a-60e8c019547c', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:22.448 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.458 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ccd0d4bb-fb8c-4f6e-81ba-cc2e1af0dbc0', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:22.602 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "overlay-role", "ref-uuid": "52fa8281-3ce5-4142-8415-8fb7a3df34c8", "ref-fq-name": ["default-global-system-config", "crb-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.613 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d06823d6-6521-48c2-bd02-a22c689bb7c6', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:22.701 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:22.758 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.768 7fcafef66e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:22.780 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a9af4140-0a94-4d8d-b786-6c425cb22c4a', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:22.931 7fcafee4f978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.931 7fcafee4f978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:22.939 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-02c0ea4b-8d85-4a9a-8577-0eb20e383239', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:23.102 7fcafee3f198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.102 7fcafee3f198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.116 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-34e47a64-0ee5-4055-9a40-9376fc0f2b3e', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:23.275 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.275 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.293 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b6a93c83-13ea-4080-a287-80e626d3761b', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:23.432 7fcaff0acac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.433 7fcaff0acac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.441 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b0552564-bc80-461c-b36c-99a3504be3bf', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:23.593 7fcafefbeb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.593 7fcafefbeb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.602 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-52e7b2de-d7ed-4f1d-b99b-2f1d11ea99a8', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:23.702 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:23.758 7fcafefdfa20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "overlay-role", "ref-uuid": "f4629d24-1017-4978-a064-1c023393456d", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.758 7fcafefdfa20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "overlay-role", "ref-uuid": "f4629d24-1017-4978-a064-1c023393456d", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.791 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b1676726-f93f-45fc-87be-07f3b9df8f04', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:23.922 7fcafef9be10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.922 7fcafef9be10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:23.942 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-07e5d46c-ea95-4d85-afee-79b50b7c7a42', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:24.086 7fcaff050588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.087 7fcaff050588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.105 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-66f03c9a-77a0-4a65-b90d-103e27b96a02', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:24.241 7fcafee028d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.241 7fcafee028d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.249 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-437831f8-6990-4c73-b5e8-cc9699744dec', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:24.410 7fcaff050d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.410 7fcaff050d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.420 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ef499e02-b3c1-444e-a209-45cf091ae364', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:24.565 7fcaff75f438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.565 7fcaff75f438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.585 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7e3b2af1-bbce-4d45-9804-2bb8c7e8bffe', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:24.703 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:24.717 7fcaff0ac198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.718 7fcaff0ac198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.725 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f42fa4e5-7c0e-46bb-903e-a937464b10c4', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:24.880 7fcafefe4a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "overlay-role", "ref-uuid": "f4629d24-1017-4978-a064-1c023393456d", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.880 7fcafefe4a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "overlay-role", "ref-uuid": "f4629d24-1017-4978-a064-1c023393456d", "ref-fq-name": ["default-global-system-config", "crb-mcast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:24.889 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c3dc056c-4fcb-4a61-b783-b2e7a849046c', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:25.041 7fcafee7f828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.041 7fcafee7f828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.050 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-18c80186-4e92-462d-8191-d55eaa3bdd37', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:25.199 7fcafef13588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.200 7fcafef13588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.213 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-539c7823-7b86-47a8-a2d4-04be908c221b', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:25.361 7fcafee9feb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.362 7fcafee9feb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.380 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-efbb0a76-16a6-4330-94fc-d28548b35d94', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:25.521 7fcafeebde10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.521 7fcafeebde10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.530 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-46c1b34e-33dd-4f37-b4cb-a54be9a4bc9b', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:25.677 7fcafefb40f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.677 7fcafefb40f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.685 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fdde17cf-dd2e-4e5e-ab08-84aa4d17ab5e', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:25.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:25.835 7fcafef2dac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "aad659a1-1c61-4d88-95c8-a01f7c570265", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.835 7fcafef2dac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "aad659a1-1c61-4d88-95c8-a01f7c570265", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.843 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e01be622-b4cf-42a3-8927-44934f6de55f', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:25.998 7fcafefb4390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:25.998 7fcafefb4390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.007 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d73492c9-952f-47ba-a0c4-fc649fc04e7e', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:26.172 7fcaff76b240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.172 7fcaff76b240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.185 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-69c27542-840e-4cfc-b6b9-b4ed90a24c75', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:26.341 7fcafef58f60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "overlay-role", "ref-uuid": "706c77c7-7700-4511-85ae-e6428a74c5dc", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.341 7fcafef58f60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "overlay-role", "ref-uuid": "706c77c7-7700-4511-85ae-e6428a74c5dc", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.353 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ef95f9fc-b320-4c23-afaf-52b6dc8bd524', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:26.512 7fcafedc1c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.512 7fcafedc1c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.520 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-61a8409a-144d-41e3-913a-e476c8e0003b', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:26.675 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "physical-role", "ref-uuid": "0ddd8b0b-16a5-4859-a867-2869146e91f8", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.675 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "physical-role", "ref-uuid": "0ddd8b0b-16a5-4859-a867-2869146e91f8", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.686 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-f39b2707-c314-4a06-9c4e-7ecfc2877e90', 'type': 'role_definition', 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'} 10/21/2024 02:02:26.706 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:26.831 7fcafee5c630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "overlay-role", "ref-uuid": "06cd946e-2698-4eeb-8ebf-fe840d3d6646", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.832 7fcafee5c630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "overlay-role", "ref-uuid": "06cd946e-2698-4eeb-8ebf-fe840d3d6646", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.839 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-e22a08ef-c974-4735-a03a-6fb2c54ceb53', 'type': 'role_definition', 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'} 10/21/2024 02:02:26.997 7fcafef5d198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:26.998 7fcafef5d198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.007 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-5aeae7cc-ca55-40f4-892e-a44055d0055a', 'type': 'role_definition', 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'} 10/21/2024 02:02:27.164 7fcafee5d630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.165 7fcafee5d630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.181 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-5ba70df4-b06b-4af2-8027-0fcb8cd1a469', 'type': 'role_definition', 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'} 10/21/2024 02:02:27.325 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.326 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3f4afa5f-9132-4072-848c-5249e395fd41 object_type = role_definition identifier_name = default-global-system-config:lean-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3f4afa5f-9132-4072-848c-5249e395fd41", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.332 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-d80fc15f-8026-4d92-88d7-b74f62d3ae50', 'type': 'role_definition', 'uuid': '3f4afa5f-9132-4072-848c-5249e395fd41'} 10/21/2024 02:02:27.489 7fcafedbea20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "overlay-role", "ref-uuid": "06cd946e-2698-4eeb-8ebf-fe840d3d6646", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.490 7fcafedbea20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "overlay-role", "ref-uuid": "06cd946e-2698-4eeb-8ebf-fe840d3d6646", "ref-fq-name": ["default-global-system-config", "lean"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.503 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-2a4571c0-32cb-4539-9561-ceb30438dd35', 'type': 'role_definition', 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'} 10/21/2024 02:02:27.653 7fcafef746d8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.653 7fcafef746d8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.662 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-7d7d6069-01ac-45ab-9519-7364fbb4c678', 'type': 'role_definition', 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'} 10/21/2024 02:02:27.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:27.773 7fcafef66e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:27.773 7fcafef66e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:27.774 7fcafef66e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:27.774 7fcafef66e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:27.774 7fcafef66e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:27.774 7fcafef66e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:27.774 7fcafef66e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:27.774 7fcafef66e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.775 7fcafef66e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:27.775 7fcafef66e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.775 7fcafef66e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.775 7fcafef66e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:27.775 7fcafef66e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:27.813 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.821 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-671315b0-7ef6-4621-85a4-4ea6cf77ffad', 'type': 'role_definition', 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'} 10/21/2024 02:02:27.973 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:27.989 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-733a2573-b2ba-48f3-a0f6-9307b02f59ef', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:28.128 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:28.136 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5ca8fe0d-0b31-4869-8a4f-4ae754216bfb', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:28.289 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:28.303 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-89405888-72a8-4070-8439-c19f615f3db7', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:28.446 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:28.453 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c8dd19f5-d0af-4bd1-a289-f6573960aa04', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:28.602 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "aad659a1-1c61-4d88-95c8-a01f7c570265", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:28.618 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bdcb7389-d76f-4350-848f-485d72ba812d', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:28.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:28.765 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:28.780 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b7aab942-97c1-4808-890e-2ba2c6aa0881', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:28.928 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:28.936 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8a11d9d3-84fa-4e62-a7f2-2601c154c8e1', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:29.089 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "overlay-role", "ref-uuid": "706c77c7-7700-4511-85ae-e6428a74c5dc", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:29.109 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-b2eeb239-71ce-4809-9b88-c72da2c99e58', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:29.240 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:29.247 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f9c7eff4-9ff0-4e8e-987b-6c8000f78095', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:29.397 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:29.414 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0cef3ec9-5904-49c8-8a44-5c5c661fd16f', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:29.576 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:29.586 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e71117fb-d078-4759-ab64-8eb3dc2e8555', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:29.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:29.741 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:29.750 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-2ab4a2cd-8384-4a62-86f2-eedbc9216359', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:29.905 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:29.916 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-9add2a77-90c0-4a4e-b894-f86633fdc1c7', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:30.073 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "aad659a1-1c61-4d88-95c8-a01f7c570265", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:30.092 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cf048b89-22fa-489b-8dd6-394027870bb4', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:30.234 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:30.248 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cfb9e3b4-9f03-4dd1-be38-4d49869bb00c', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:30.393 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:30.403 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-39885e4c-a6dd-4a4b-ba6c-ed67254ff27e', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:30.550 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "overlay-role", "ref-uuid": "b8375eeb-d384-4caf-a86c-14a65ec282de", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:30.560 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d3204f04-8d2a-4645-aadd-2321b2c766d8', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:30.709 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:30.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:30.718 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-40b132a7-464c-4b94-9e30-80baef2e70d7', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:30.867 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:30.892 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2b9e7a04-a0a2-4fce-9091-3fea139c1981', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:31.043 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.066 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5bdc32a4-7f2a-41e5-a8b7-42743fa131c6', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:31.220 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.233 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-eb8c7c20-8205-45a5-aaad-9dba08b5a3bc', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:31.385 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.396 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7c185aaa-1687-4094-8fad-9b373c1961b6', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:31.552 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "aad659a1-1c61-4d88-95c8-a01f7c570265", "ref-fq-name": ["default-global-system-config", "dc-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.583 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f2fd10e0-53d6-490e-abd4-70a02103f503', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:31.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:31.724 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.742 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f7c2b5a8-bdee-40c5-b14f-bda8bdedd1c3', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:31.778 7fcafefe1390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:31.886 7fcafef9c588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.886 7fcafef9c588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:31.913 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-300f9e87-cf6a-4a90-b59f-50ba7c155349', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:32.096 7fcafee4f630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "overlay-role", "ref-uuid": "b8375eeb-d384-4caf-a86c-14a65ec282de", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.096 7fcafee4f630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "overlay-role", "ref-uuid": "b8375eeb-d384-4caf-a86c-14a65ec282de", "ref-fq-name": ["default-global-system-config", "dci-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.111 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6fc868fa-b0a6-415f-ad78-1c2110b60853', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:32.258 7fcafedb1240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.258 7fcafedb1240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.266 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3a825c13-e376-43be-885b-c4bb2d7df10b', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:32.417 7fcafee4ff60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "overlay-role", "ref-uuid": "d6b97556-af3e-4805-9138-9368b77fb7e4", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.418 7fcafee4ff60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "overlay-role", "ref-uuid": "d6b97556-af3e-4805-9138-9368b77fb7e4", "ref-fq-name": ["default-global-system-config", "crb-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.425 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-da869431-874c-4c93-bb5d-cb5a22a30223', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:32.572 7fcafee3f240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.572 7fcafee3f240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.587 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-27c577bb-040d-4aa5-9979-ed078c2a14df', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:32.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:32.738 7fcaff06ce10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.739 7fcaff06ce10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.753 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-df0c59c6-7ea5-4343-9bbe-b8f80c0146fa', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:32.894 7fcafef66390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.894 7fcafef66390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:32.906 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0d63e8da-1a2c-47d2-a596-ad5b734be275', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:33.066 7fcafef47048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.066 7fcafef47048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.086 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-373122ff-9c21-4cf9-b24a-9466133f1c73', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:33.249 7fcafef2df60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.249 7fcafef2df60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.257 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-4847f6fd-e917-43aa-9e44-e59f979257c9', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:33.401 7fcaff06c828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.401 7fcaff06c828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.409 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-447ab057-b157-4b8b-aed7-8821c6c9d663', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:33.561 7fcafee18588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.561 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.573 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-63173f2f-95d9-4d51-aff0-967f9f542b6d', 'type': 'role_definition', 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'} 10/21/2024 02:02:33.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:33.732 7fcafef2d588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.733 7fcafef2d588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.739 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-fabb3d15-a318-4ee4-930f-6c37a4d55b34', 'type': 'role_definition', 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'} 10/21/2024 02:02:33.887 7fcafedc14e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.887 7fcafedc14e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "feature", "ref-uuid": "0bcd3189-e03f-4345-baf1-c4e0305669ec", "ref-fq-name": ["default-global-system-config", "assisted-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:33.896 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-134c3dbd-5b0f-4df5-8b39-63cadf9bcb6a', 'type': 'role_definition', 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'} 10/21/2024 02:02:34.050 7fcafeee6cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.050 7fcafeee6cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.059 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-96a6d83c-b4ca-4ba6-ab8a-c323f6144559', 'type': 'role_definition', 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'} 10/21/2024 02:02:34.210 7fcafedbe048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.211 7fcafedbe048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.222 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f068a41c-d7d8-4862-8748-256d131f3932', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:34.378 7fcafef748d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "overlay-role", "ref-uuid": "6c1f199c-73ea-47c9-b9d1-b9efd8a46c67", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.378 7fcafef748d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "overlay-role", "ref-uuid": "6c1f199c-73ea-47c9-b9d1-b9efd8a46c67", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.388 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-5bf47ee4-04b3-4722-92d1-274c2901d7c9', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:34.529 7fcafee26588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.529 7fcafee26588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.536 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-d74d1bbf-fc79-4c6c-ac9f-dd9f1b54732e', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:34.686 7fcafedc1240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "overlay-role", "ref-uuid": "6c1f199c-73ea-47c9-b9d1-b9efd8a46c67", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.687 7fcafedc1240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "overlay-role", "ref-uuid": "6c1f199c-73ea-47c9-b9d1-b9efd8a46c67", "ref-fq-name": ["default-global-system-config", "ar-replicator"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.699 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-640ba6cc-c06d-4413-9b58-538f22b9cf71', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:34.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:34.841 7fcafef58390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.841 7fcafef58390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:34.847 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d733d1a9-820e-4d66-822d-f6a69b831a95', 'type': 'role_definition', 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'} 10/21/2024 02:02:35.000 7fcafef74c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "overlay-role", "ref-uuid": "6b61877d-8806-47ad-849d-6f94b102b345", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.001 7fcafef74c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "overlay-role", "ref-uuid": "6b61877d-8806-47ad-849d-6f94b102b345", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.012 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-07ce019a-1e93-4887-b027-3925157465f2', 'type': 'role_definition', 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'} 10/21/2024 02:02:35.162 7fcafed50780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.163 7fcafed50780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.172 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-ecf2cc49-ead5-4138-83e9-b95312003e35', 'type': 'role_definition', 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'} 10/21/2024 02:02:35.322 7fcaff000b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.322 7fcaff000b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.331 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-f9ec03ca-40ad-4ec1-9612-637fd34ee41a', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:35.487 7fcafeca1e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "physical-role", "ref-uuid": "0ddd8b0b-16a5-4859-a867-2869146e91f8", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.488 7fcafeca1e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "physical-role", "ref-uuid": "0ddd8b0b-16a5-4859-a867-2869146e91f8", "ref-fq-name": ["default-global-system-config", "superspine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.503 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2476b521-6f19-4a41-8bb0-8f6c79b4effb', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:35.645 7fcafef2d390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.646 7fcafef2d390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.655 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6d5c8fe6-2c27-4ff8-9847-a7138d5b4b56', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:35.720 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:35.805 7fcafedbea20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "overlay-role", "ref-uuid": "6b61877d-8806-47ad-849d-6f94b102b345", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.805 7fcafedbea20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "overlay-role", "ref-uuid": "6b61877d-8806-47ad-849d-6f94b102b345", "ref-fq-name": ["default-global-system-config", "ar-client"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.814 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-9afccaab-cd43-4c8a-b6e6-1acdc20d73db', 'type': 'role_definition', 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'} 10/21/2024 02:02:35.981 7fcafecb7b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "overlay-role", "ref-uuid": "35433cb2-3e9e-4d49-aecd-4b2516c0c257", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.982 7fcafecb7b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "overlay-role", "ref-uuid": "35433cb2-3e9e-4d49-aecd-4b2516c0c257", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:35.997 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-112dbcda-7652-45fb-a3da-e9b065ec431a', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:36.141 7fcaff02bb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.141 7fcaff02bb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.149 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2c7b762b-0bf0-4a68-adff-3be239c5c8e8', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:36.298 7fcaff0132e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.298 7fcaff0132e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.307 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-74945786-60e2-47c5-860d-ec9579fed3dc', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:36.457 7fcaff02bf60 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.457 7fcaff02bf60 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.466 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-baad4384-8275-4af8-b8e5-ca1fde32f7b8', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:36.609 7fcafecad240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.609 7fcafecad240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e1958f-d9ca-4ad2-852e-498cead4c7e5 object_type = role_definition identifier_name = default-global-system-config:rr-superspine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b2e1958f-d9ca-4ad2-852e-498cead4c7e5", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.618 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-e2eb7596-1427-4053-bee2-1bd677d40a75', 'type': 'role_definition', 'uuid': 'b2e1958f-d9ca-4ad2-852e-498cead4c7e5'} 10/21/2024 02:02:36.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:36.774 7fcafefad8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "overlay-role", "ref-uuid": "35433cb2-3e9e-4d49-aecd-4b2516c0c257", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.775 7fcafefad8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "overlay-role", "ref-uuid": "35433cb2-3e9e-4d49-aecd-4b2516c0c257", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.786 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-e7c217d9-0726-469a-ba10-4ae385cc5c42', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:36.787 7fcafefe1390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:36.787 7fcafefe1390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:36.787 7fcafefe1390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:36.787 7fcafefe1390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:36.788 7fcafefe1390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:36.788 7fcafefe1390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:36.788 7fcafefe1390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:36.788 7fcafefe1390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.788 7fcafefe1390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:36.788 7fcafefe1390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.789 7fcafefe1390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.789 7fcafefe1390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:36.789 7fcafefe1390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:36.937 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:36.946 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-43a5f2b6-ddfa-4a7b-b78a-fab6eae0bf65', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:37.099 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:37.122 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-d2866592-fb7a-47b9-a475-7fb10369f96d', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:37.274 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:37.290 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-0a0246c0-952c-4d63-8c9e-f5514fde331d', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:37.440 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:37.451 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a8dbab07-6215-4908-95b2-ddc2808d74b7', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:37.602 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:37.612 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2a2a3467-832b-4001-a3f1-65514564c8d7', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:37.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:37.766 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:37.783 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-78206056-d1c9-49fc-a64f-910faa79f401', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:37.936 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "overlay-role", "ref-uuid": "35433cb2-3e9e-4d49-aecd-4b2516c0c257", "ref-fq-name": ["default-global-system-config", "route-reflector"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:37.946 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9a460175-3283-4824-baee-32e2bc0c44d9', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:38.104 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = fd56adce-c380-4d37-82b4-a7632ec59340 object_type = role_definition identifier_name = default-global-system-config:erb-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "fd56adce-c380-4d37-82b4-a7632ec59340", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:38.117 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-92ca7eef-96d2-47ff-8141-d095a9257c85', 'type': 'role_definition', 'uuid': 'fd56adce-c380-4d37-82b4-a7632ec59340'} 10/21/2024 02:02:38.262 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5ca0888b-5395-41cf-876d-9ae63478b4d7 object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5ca0888b-5395-41cf-876d-9ae63478b4d7", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:38.271 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0c4e3047-9f5e-433d-8f2e-3c51aba45f99', 'type': 'role_definition', 'uuid': '5ca0888b-5395-41cf-876d-9ae63478b4d7'} 10/21/2024 02:02:38.428 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ae5e59bc-be59-44eb-bff8-682f148dbb35 object_type = role_definition identifier_name = default-global-system-config:crb-access-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "ae5e59bc-be59-44eb-bff8-682f148dbb35", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:38.435 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-d5d38367-21c6-4578-8c07-c346340f7881', 'type': 'role_definition', 'uuid': 'ae5e59bc-be59-44eb-bff8-682f148dbb35'} 10/21/2024 02:02:38.590 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:38.600 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-47b4c0be-8070-43e5-9b70-76072a73d47c', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:38.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:38.748 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:38.756 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b9f45688-c147-4422-b90b-4ca6eaed0a02', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:38.914 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9224d094-90dc-46ce-a5ff-ed89cc5c8e13 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9224d094-90dc-46ce-a5ff-ed89cc5c8e13", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:38.927 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b9221037-8c46-4bd6-855d-1456b8fd52a1', 'type': 'role_definition', 'uuid': '9224d094-90dc-46ce-a5ff-ed89cc5c8e13'} 10/21/2024 02:02:39.077 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b80b8d10-3801-4bcf-9e87-5c897d3fb268 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "b80b8d10-3801-4bcf-9e87-5c897d3fb268", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:39.091 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-d0c825b1-4fa1-4fe2-b4c3-90149db84e61', 'type': 'role_definition', 'uuid': 'b80b8d10-3801-4bcf-9e87-5c897d3fb268'} 10/21/2024 02:02:39.245 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:39.253 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-608ea966-f5cf-4b06-8557-a216e6402b09', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:39.409 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:39.417 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-eb980534-304c-41ff-a39c-fd3366bcc4cf', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:39.565 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 59267292-48e3-4fb2-a02f-6a5b06686293 object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "59267292-48e3-4fb2-a02f-6a5b06686293", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:39.576 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-952388c7-4236-44fe-8eec-be7e5fc7c0c7', 'type': 'role_definition', 'uuid': '59267292-48e3-4fb2-a02f-6a5b06686293'} 10/21/2024 02:02:39.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:39.729 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 02072fed-c815-4c6a-a20d-5dc4cc8d8802 object_type = role_definition identifier_name = default-global-system-config:dci-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "02072fed-c815-4c6a-a20d-5dc4cc8d8802", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:39.744 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1c7d6c57-6aa4-409f-8024-c653b0f73336', 'type': 'role_definition', 'uuid': '02072fed-c815-4c6a-a20d-5dc4cc8d8802'} 10/21/2024 02:02:39.898 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 04ec5bfa-b971-465c-a3a2-345bb8f69525 object_type = role_definition identifier_name = default-global-system-config:ar-client-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "04ec5bfa-b971-465c-a3a2-345bb8f69525", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:39.907 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4aeda354-41c2-41b3-b18e-94624f9bb039', 'type': 'role_definition', 'uuid': '04ec5bfa-b971-465c-a3a2-345bb8f69525'} 10/21/2024 02:02:40.062 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a8468c8e-1cdf-4b9e-acfd-71dc0d74411d object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a8468c8e-1cdf-4b9e-acfd-71dc0d74411d", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.073 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-e9e21213-10fd-47f1-bc08-894038ffede5', 'type': 'role_definition', 'uuid': 'a8468c8e-1cdf-4b9e-acfd-71dc0d74411d'} 10/21/2024 02:02:40.223 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5a0baeaf-5398-4f7a-8423-0196ea7b1c77 object_type = role_definition identifier_name = default-global-system-config:ar-replicator-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5a0baeaf-5398-4f7a-8423-0196ea7b1c77", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.234 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-457569e2-91f4-439a-8df7-3d9bcea5141e', 'type': 'role_definition', 'uuid': '5a0baeaf-5398-4f7a-8423-0196ea7b1c77'} 10/21/2024 02:02:40.389 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e9f48d50-6373-4f3e-82e3-3bee61fc677f object_type = role_definition identifier_name = default-global-system-config:ar-replicator-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "e9f48d50-6373-4f3e-82e3-3bee61fc677f", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.398 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-8120d69e-dbc6-4ce3-9ef7-84d5c308368a', 'type': 'role_definition', 'uuid': 'e9f48d50-6373-4f3e-82e3-3bee61fc677f'} 10/21/2024 02:02:40.549 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9919ace2-1f02-4784-9de1-4faca0b85518 object_type = role_definition identifier_name = default-global-system-config:rr-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9919ace2-1f02-4784-9de1-4faca0b85518", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.559 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-1be8795b-9d9c-482d-927e-110f2ea61ecb', 'type': 'role_definition', 'uuid': '9919ace2-1f02-4784-9de1-4faca0b85518'} 10/21/2024 02:02:40.709 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5e1bcb1d-9961-4a1d-b348-e62e72befc12 object_type = role_definition identifier_name = default-global-system-config:rr-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "5e1bcb1d-9961-4a1d-b348-e62e72befc12", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.717 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-cd99b2f0-8ccb-4376-92dd-695cc80cd3e7', 'type': 'role_definition', 'uuid': '5e1bcb1d-9961-4a1d-b348-e62e72befc12'} 10/21/2024 02:02:40.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:40.787 7fcaff012b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:40.863 7fcaff0524e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.863 7fcaff0524e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:40.874 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-a5f06eb7-06af-4e9d-86d8-8a8d80304681', 'type': 'role_definition', 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'} 10/21/2024 02:02:41.023 7fcafee4f048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.024 7fcafee4f048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.034 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e4b9d2f5-74e5-411e-8f82-a2155db8571a', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:41.186 7fcafef7d8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.186 7fcafef7d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 19781bba-bfc1-4895-8ecb-a314472c29a4 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "19781bba-bfc1-4895-8ecb-a314472c29a4", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.197 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8897720d-e641-404b-bc6c-2c9ed59aebb8', 'type': 'role_definition', 'uuid': '19781bba-bfc1-4895-8ecb-a314472c29a4'} 10/21/2024 02:02:41.345 7fcafee7f4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.346 7fcafee7f4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.353 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-23bbd5a3-d1a2-47ee-b99c-d88385c85a67', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:41.506 7fcaff0ac630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.506 7fcaff0ac630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 246a3b1d-d1b8-49d1-bb29-67f620251574 object_type = role_definition identifier_name = default-global-system-config:crb-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "246a3b1d-d1b8-49d1-bb29-67f620251574", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.516 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4b3c8469-185b-4d2e-a90e-cb9707fd3036', 'type': 'role_definition', 'uuid': '246a3b1d-d1b8-49d1-bb29-67f620251574'} 10/21/2024 02:02:41.657 7fcafef0b588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.658 7fcafef0b588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.666 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4aebed9e-58a2-46ea-8a09-fff7a8fe55dd', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:41.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:41.813 7fcafef62780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.814 7fcafef62780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1b4a419b-c406-487e-96d0-9252f39d8b40 object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "1b4a419b-c406-487e-96d0-9252f39d8b40", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.823 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e6125c33-2889-4b3c-90bb-8cec829b9838', 'type': 'role_definition', 'uuid': '1b4a419b-c406-487e-96d0-9252f39d8b40'} 10/21/2024 02:02:41.967 7fcafee7fb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.967 7fcafee7fb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:41.992 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3299350e-b0ad-48ed-a480-bd426da38f24', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:42.142 7fcafee06780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.142 7fcafee06780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4422dc31-4c47-4e8b-86c7-2b89af992b4c object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "4422dc31-4c47-4e8b-86c7-2b89af992b4c", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.150 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c0c64c82-dd16-487b-9d3e-a43512b6179b', 'type': 'role_definition', 'uuid': '4422dc31-4c47-4e8b-86c7-2b89af992b4c'} 10/21/2024 02:02:42.336 7fcafef62390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.336 7fcafef62390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 040b0ce7-7a1f-4d92-afb6-0f07c10393c5 object_type = role_definition identifier_name = default-global-system-config:lean-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "040b0ce7-7a1f-4d92-afb6-0f07c10393c5", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.365 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-4c0dd720-cdd6-46c0-9a72-1b77c1f9f235', 'type': 'role_definition', 'uuid': '040b0ce7-7a1f-4d92-afb6-0f07c10393c5'} 10/21/2024 02:02:42.478 7fcafee18630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.478 7fcafee18630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "c3d53bf1-25a4-498c-8098-7fbfd3da9b63", "ref-fq-name": ["default-global-system-config", "l3-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.489 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-1781515f-943d-40d3-87d2-8fe36cc4944b', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:42.638 7fcafef62048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.638 7fcafef62048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "fcd8b4f3-3030-419e-95ff-1a43644c6f25", "ref-fq-name": ["default-global-system-config", "underlay-ip-clos"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.653 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-93805633-3bf0-4a91-a5a0-5c1f3a43a3ee', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:42.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:42.809 7fcafef16198 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.809 7fcafef16198 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "1cae003f-6bfc-4408-ac8d-fe52eb73fc0e", "ref-fq-name": ["default-global-system-config", "vn-interconnect"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.817 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-8351d919-a93a-4a4c-9dba-453f3ccd87a0', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:42.974 7fcafef6a4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.975 7fcafef6a4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "2a79723b-4b29-4873-9a06-afd87d94a000", "ref-fq-name": ["default-global-system-config", "telemetry"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:42.983 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-9d7df8ce-bb29-43ce-8c64-d6bcdd7c1dc6', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:43.129 7fcafeebdac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.129 7fcafeebdac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "ea340d12-5132-4f94-87f7-2f84959c5daf", "ref-fq-name": ["default-global-system-config", "overlay-bgp"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.136 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-b8f8abaf-122c-4609-9564-64ddd31bf763', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:43.283 7fcafedd98d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.283 7fcafedd98d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "b48fbcb9-c24c-42f7-a955-246b2a4c6f7f", "ref-fq-name": ["default-global-system-config", "l2-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.296 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-7646af3f-c93d-41dc-a9c9-e11a34ff20e6', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:43.450 7fcafef9b4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.450 7fcafef9b4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "a3ccd2bf-f4d0-4ab6-af8e-713a5e4cab15", "ref-fq-name": ["default-global-system-config", "firewall"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.463 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-e09e8e13-56a5-4d96-9f22-6a8d663930a8', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:43.623 7fcafedd9390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.623 7fcafedd9390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "0a161206-845b-465c-81b7-e42ab625fe4a", "ref-fq-name": ["default-global-system-config", "infra-bms-access"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.632 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-a1628816-bf8a-4148-8e4f-06be2252b0f6', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:43.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:43.786 7fcafecad978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.787 7fcafecad978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "feature", "ref-uuid": "af825e9b-24e6-4795-a899-ac78cc3abc5c", "ref-fq-name": ["default-global-system-config", "port-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.797 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-5cf3e095-b29b-4fa7-b577-e83792086918', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:43.963 7fcafeebd978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "overlay-role", "ref-uuid": "b6383016-0852-44fe-b225-68985dc85cd8", "ref-fq-name": ["default-global-system-config", "collapsed-spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.963 7fcafeebd978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "overlay-role", "ref-uuid": "b6383016-0852-44fe-b225-68985dc85cd8", "ref-fq-name": ["default-global-system-config", "collapsed-spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:43.982 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-74c45b68-00a1-4a0f-b225-76eeb73ea247', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:44.123 7fcaff064cc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.123 7fcaff064cc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c object_type = role_definition identifier_name = default-global-system-config:collapsed-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.133 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-079af54d-04d3-4087-8150-9e6d2583f912', 'type': 'role_definition', 'uuid': '3a0491d4-b23d-4920-9ca3-a3fc8fce8d7c'} 10/21/2024 02:02:44.287 7fcafecb7a20 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a3fbaac3-3e5f-4cac-8e0f-57d620f1a384 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a3fbaac3-3e5f-4cac-8e0f-57d620f1a384", "ref-type": "feature", "ref-uuid": "c24da9bf-2bc3-4d04-be40-e6c29321fb74", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.288 7fcafecb7a20 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a3fbaac3-3e5f-4cac-8e0f-57d620f1a384 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a3fbaac3-3e5f-4cac-8e0f-57d620f1a384", "ref-type": "feature", "ref-uuid": "c24da9bf-2bc3-4d04-be40-e6c29321fb74", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.310 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-fd5ebed5-40a3-42e6-a650-05b9f396e789', 'type': 'role_definition', 'uuid': 'a3fbaac3-3e5f-4cac-8e0f-57d620f1a384'} 10/21/2024 02:02:44.458 7fcaff064b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9abb47a4-1b57-41ac-92e9-93b0278fa5a2 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9abb47a4-1b57-41ac-92e9-93b0278fa5a2", "ref-type": "feature", "ref-uuid": "c24da9bf-2bc3-4d04-be40-e6c29321fb74", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.458 7fcaff064b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9abb47a4-1b57-41ac-92e9-93b0278fa5a2 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9abb47a4-1b57-41ac-92e9-93b0278fa5a2", "ref-type": "feature", "ref-uuid": "c24da9bf-2bc3-4d04-be40-e6c29321fb74", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.479 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-d1ab4167-e663-4812-a2eb-9bf3d7854018', 'type': 'role_definition', 'uuid': '9abb47a4-1b57-41ac-92e9-93b0278fa5a2'} 10/21/2024 02:02:44.623 7fcaff069e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a2572c8-8d47-45fa-bed3-917a3b3ce3b8 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "7a2572c8-8d47-45fa-bed3-917a3b3ce3b8", "ref-type": "feature", "ref-uuid": "c24da9bf-2bc3-4d04-be40-e6c29321fb74", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.623 7fcaff069e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a2572c8-8d47-45fa-bed3-917a3b3ce3b8 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "7a2572c8-8d47-45fa-bed3-917a3b3ce3b8", "ref-type": "feature", "ref-uuid": "c24da9bf-2bc3-4d04-be40-e6c29321fb74", "ref-fq-name": ["default-global-system-config", "pnf-service-chaining"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.642 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-db25005b-bb4c-4fda-a6e3-0d974c52b8dc', 'type': 'role_definition', 'uuid': '7a2572c8-8d47-45fa-bed3-917a3b3ce3b8'} 10/21/2024 02:02:44.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:44.790 7fcafeebde10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a3fbaac3-3e5f-4cac-8e0f-57d620f1a384 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a3fbaac3-3e5f-4cac-8e0f-57d620f1a384", "ref-type": "physical-role", "ref-uuid": "0725e566-abb5-40ce-b0f7-af428a4e7fa9", "ref-fq-name": ["default-global-system-config", "pnf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.791 7fcafeebde10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a3fbaac3-3e5f-4cac-8e0f-57d620f1a384 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a3fbaac3-3e5f-4cac-8e0f-57d620f1a384", "ref-type": "physical-role", "ref-uuid": "0725e566-abb5-40ce-b0f7-af428a4e7fa9", "ref-fq-name": ["default-global-system-config", "pnf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.800 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-ddeb8c4e-020a-470d-9126-438087f9ae24', 'type': 'role_definition', 'uuid': 'a3fbaac3-3e5f-4cac-8e0f-57d620f1a384'} 10/21/2024 02:02:44.949 7fcafec6a8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9abb47a4-1b57-41ac-92e9-93b0278fa5a2 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9abb47a4-1b57-41ac-92e9-93b0278fa5a2", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.949 7fcafec6a8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9abb47a4-1b57-41ac-92e9-93b0278fa5a2 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9abb47a4-1b57-41ac-92e9-93b0278fa5a2", "ref-type": "physical-role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:44.959 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-ed05c423-c8d6-4a1c-a60e-59a7eb9cf7ae', 'type': 'role_definition', 'uuid': '9abb47a4-1b57-41ac-92e9-93b0278fa5a2'} 10/21/2024 02:02:45.103 7fcafef628d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a2572c8-8d47-45fa-bed3-917a3b3ce3b8 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "7a2572c8-8d47-45fa-bed3-917a3b3ce3b8", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.103 7fcafef628d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a2572c8-8d47-45fa-bed3-917a3b3ce3b8 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "7a2572c8-8d47-45fa-bed3-917a3b3ce3b8", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.118 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6a7812d5-9499-472e-b2dc-fc1ab341157e', 'type': 'role_definition', 'uuid': '7a2572c8-8d47-45fa-bed3-917a3b3ce3b8'} 10/21/2024 02:02:45.278 7fcaff02f2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a3fbaac3-3e5f-4cac-8e0f-57d620f1a384 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a3fbaac3-3e5f-4cac-8e0f-57d620f1a384", "ref-type": "overlay-role", "ref-uuid": "c15471d4-1d4c-4d21-a5d7-4a7f5295265c", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.278 7fcaff02f2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a3fbaac3-3e5f-4cac-8e0f-57d620f1a384 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-pnf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "a3fbaac3-3e5f-4cac-8e0f-57d620f1a384", "ref-type": "overlay-role", "ref-uuid": "c15471d4-1d4c-4d21-a5d7-4a7f5295265c", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.292 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-9d6b0ef5-7819-4bc1-b10a-ec3b70627ab2', 'type': 'role_definition', 'uuid': 'a3fbaac3-3e5f-4cac-8e0f-57d620f1a384'} 10/21/2024 02:02:45.446 7fcafeec80f0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9abb47a4-1b57-41ac-92e9-93b0278fa5a2 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9abb47a4-1b57-41ac-92e9-93b0278fa5a2", "ref-type": "overlay-role", "ref-uuid": "c15471d4-1d4c-4d21-a5d7-4a7f5295265c", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.447 7fcafeec80f0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9abb47a4-1b57-41ac-92e9-93b0278fa5a2 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "9abb47a4-1b57-41ac-92e9-93b0278fa5a2", "ref-type": "overlay-role", "ref-uuid": "c15471d4-1d4c-4d21-a5d7-4a7f5295265c", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.462 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-4fc066d2-b546-4adc-b29b-42bd2fe48e09', 'type': 'role_definition', 'uuid': '9abb47a4-1b57-41ac-92e9-93b0278fa5a2'} 10/21/2024 02:02:45.609 7fcafee4fd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a2572c8-8d47-45fa-bed3-917a3b3ce3b8 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "7a2572c8-8d47-45fa-bed3-917a3b3ce3b8", "ref-type": "overlay-role", "ref-uuid": "c15471d4-1d4c-4d21-a5d7-4a7f5295265c", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.609 7fcafee4fd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7a2572c8-8d47-45fa-bed3-917a3b3ce3b8 object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "role-definition", "uuid": "7a2572c8-8d47-45fa-bed3-917a3b3ce3b8", "ref-type": "overlay-role", "ref-uuid": "c15471d4-1d4c-4d21-a5d7-4a7f5295265c", "ref-fq-name": ["default-global-system-config", "pnf-servicechain"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.618 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-89c8e023-ef13-4a5e-9fac-4e08ae631bbb', 'type': 'role_definition', 'uuid': '7a2572c8-8d47-45fa-bed3-917a3b3ce3b8'} 10/21/2024 02:02:45.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:45.765 7fcafec7d240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "13f80bf2-bb59-4e58-9dfc-4d2f2ef8da50", "ref-fq-name": ["juniper-qfx5100-48sh-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.765 7fcafec7d240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "13f80bf2-bb59-4e58-9dfc-4d2f2ef8da50", "ref-fq-name": ["juniper-qfx5100-48sh-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.775 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-10dcb8d1-efc1-44a2-ab5d-59a5c97a280a', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:45.791 7fcaff012b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:45.791 7fcaff012b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:45.791 7fcaff012b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:45.791 7fcaff012b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:45.791 7fcaff012b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:45.792 7fcaff012b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:45.792 7fcaff012b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:45.792 7fcaff012b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.792 7fcaff012b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:45.792 7fcaff012b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.792 7fcaff012b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.793 7fcaff012b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:45.793 7fcaff012b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:45.922 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "71624e0f-0006-41e8-a53f-9788161fbff9", "ref-fq-name": ["juniper-qfx5100-48sh-afo"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:45.928 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-dc12fcca-af00-4452-8a28-b37bb4eddfa6', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:46.080 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "6c36e253-dc09-4eac-a63b-ae2edf39a5b4", "ref-fq-name": ["juniper-qfx5100-48th-afi"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:46.089 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-0549dd56-a323-4533-98d4-e8fd755a1c42', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:46.242 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "a2135bf1-c5d9-40ef-b404-0dc6251d45d2", "ref-fq-name": ["juniper-qfx5100-48th-afo"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:46.248 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-89f589ba-f938-4173-b2c7-defedb598189', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:46.407 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "b4fa71d7-0474-4adf-9844-4a0b07ec393d", "ref-fq-name": ["juniper-qfx5100-48s-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:46.415 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-870ad703-a08d-4704-945b-0675ff17b3ba', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:46.566 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "cbcdbf43-cbaa-4c5e-b688-a52513614bb6", "ref-fq-name": ["juniper-qfx5100-96s-8q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:46.574 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-15726cba-a96e-48b5-a0be-8086d5aad3fe', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:46.726 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "d73165b0-1df9-40b1-8cad-9f7b52d06b2a", "ref-fq-name": ["juniper-qfx5100-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:46.733 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-c5f0afe0-6c38-4c67-b981-738f1c34c5b8', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:46.886 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "c102542e-45e7-44aa-83a1-717b249a840e", "ref-fq-name": ["juniper-qfx5100-48t-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:46.897 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-7e86e225-0509-49d1-8fb7-da9c4e490afb', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:47.042 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "a7b0f40e-0a24-4bfc-8d52-65c50fcab0c3", "ref-fq-name": ["juniper-qfx5100-24q-2p"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:47.050 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-133d1889-f5e1-4d40-a355-172b7c3d195a', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:47.234 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "993c1b44-0a4d-4a90-acc6-81a31f00acd7", "ref-fq-name": ["juniper-qfx5100-24q-aa"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:47.244 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-3c67db44-9312-4359-84b4-7db2675a4a40', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:47.398 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "4173fb16-69c7-4800-b535-9b37c03c6809", "ref-fq-name": ["juniper-qfx5100e-48s-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:47.410 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-938a838a-4b85-41b4-aa5a-487bce174ef6', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:47.561 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "0f7db0ac-0eab-4134-975b-5536773b1526", "ref-fq-name": ["juniper-qfx5100e-96s-8q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:47.571 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-30b97137-9c1a-4131-ba06-dba336d81878', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:47.695 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:47.719 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "8d9a6eda-0788-41f9-8ea6-774370144015", "ref-fq-name": ["juniper-qfx5100e-48t-6q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:47.730 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-2d960b8b-3d33-44ef-9b74-8ef59725dbab', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:47.879 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "f8c62f4a-1d3a-47cd-b042-d9d7b87802e4", "ref-fq-name": ["juniper-qfx5100e-24q-2p"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:47.913 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-25e06b3d-4b6c-4cf0-a27c-7666a01c42ff', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:48.075 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "hardware", "ref-uuid": "97d067ee-a388-48fa-aae6-be80afe84711", "ref-fq-name": ["juniper-qfx5110-48s-4c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:48.112 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-9ef67fac-9009-4606-a8ad-3378ea7f987b', 'type': 'node_profile', 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'} 10/21/2024 02:02:48.272 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "hardware", "ref-uuid": "63b18f61-b817-415a-991d-6ba25dafa880", "ref-fq-name": ["juniper-qfx5110-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:48.283 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-9464f866-5e2b-4ccb-8fe7-dbae9396a7aa', 'type': 'node_profile', 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'} 10/21/2024 02:02:48.645 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = eebf520a-2ed6-48e9-9676-56c8cae13e8b object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "eebf520a-2ed6-48e9-9676-56c8cae13e8b", "ref-type": "hardware", "ref-uuid": "82cda30e-5fed-4fbe-8f3c-50830f5ef54f", "ref-fq-name": ["juniper-qfx5120-48y-8c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:48.659 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-7c9555af-3507-4ede-a935-f230a0caee91', 'type': 'node_profile', 'uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b'} 10/21/2024 02:02:48.699 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:48.803 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = eebf520a-2ed6-48e9-9676-56c8cae13e8b object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "eebf520a-2ed6-48e9-9676-56c8cae13e8b", "ref-type": "hardware", "ref-uuid": "1269dcef-6cb3-4293-aa7e-94cc687ab58b", "ref-fq-name": ["juniper-qfx5120-32c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:48.814 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-0773006e-6d4b-4b6e-a232-b9b6e5a0a4de', 'type': 'node_profile', 'uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b'} 10/21/2024 02:02:48.973 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = eebf520a-2ed6-48e9-9676-56c8cae13e8b object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "eebf520a-2ed6-48e9-9676-56c8cae13e8b", "ref-type": "hardware", "ref-uuid": "836881f4-19ac-481d-8990-106acdab2b46", "ref-fq-name": ["juniper-qfx5120-48t-6c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:48.985 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-650b82db-587f-44c7-b5bf-fb957dd736d3', 'type': 'node_profile', 'uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b'} 10/21/2024 02:02:49.141 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "dcd810b0-1998-497c-b6dc-f078b57b9313", "ref-fq-name": ["juniper-qfx5200-32c-32q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.149 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-56451cba-f93e-4644-a7c8-6cb859ddb86c', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:49.300 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "ae246c43-ef7d-4b0a-a670-c61c9cd97527", "ref-fq-name": ["juniper-qfx5200-48y"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.317 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-d7ba88be-935f-4016-b8cb-b55ce3980c24', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:49.465 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "hardware", "ref-uuid": "4b2dde92-de2e-4201-bfae-7250cb10914a", "ref-fq-name": ["juniper-qfx5210-64c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.493 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-624d12f2-e1f6-482b-b71a-8403007dde54', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:49.629 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0ab14e22-8b06-45b7-8723-202a66bcfc46 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "0ab14e22-8b06-45b7-8723-202a66bcfc46", "ref-type": "hardware", "ref-uuid": "7c401b36-4378-4bb1-a97e-fee04ae988c7", "ref-fq-name": ["juniper-qfx5220-32cd"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.664 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-af2c7295-05d9-4ede-a744-994314585b75', 'type': 'node_profile', 'uuid': '0ab14e22-8b06-45b7-8723-202a66bcfc46'} 10/21/2024 02:02:49.703 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:49.787 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0ab14e22-8b06-45b7-8723-202a66bcfc46 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "0ab14e22-8b06-45b7-8723-202a66bcfc46", "ref-type": "hardware", "ref-uuid": "2e7c0f00-c79b-4ee2-8ab5-50ffde81637c", "ref-fq-name": ["juniper-qfx5220-128c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.791 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:49.807 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-90fff66e-e932-4abf-8722-d74d8051d777', 'type': 'node_profile', 'uuid': '0ab14e22-8b06-45b7-8723-202a66bcfc46'} 10/21/2024 02:02:49.948 7fcafec7d4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "83623cbc-983c-4dcb-8bfe-8b9b8dc5b180", "ref-fq-name": ["juniper-qfx10002-72q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.948 7fcafec7d4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "83623cbc-983c-4dcb-8bfe-8b9b8dc5b180", "ref-fq-name": ["juniper-qfx10002-72q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:49.961 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-64b24861-2c58-4061-8525-b8a0e842aef7', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:50.121 7fcaff02b8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "7a8aa53d-8d2d-49b4-976f-9763840f66c3", "ref-fq-name": ["juniper-qfx10002-36q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.121 7fcaff02b8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "7a8aa53d-8d2d-49b4-976f-9763840f66c3", "ref-fq-name": ["juniper-qfx10002-36q"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.138 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-6fe69b6e-9f03-4b9e-837f-af9bce10a5b5', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:50.165 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:02:50.165 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:02:50.166 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:02:50.167 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:02:50.168 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:02:50.168 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:02:50.168 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:02:50.168 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:02:50.168 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:02:50.168 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:02:50.169 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:02:50.169 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:02:50.169 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:02:50.169 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:02:50.169 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:02:50.169 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:02:50.170 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:02:50.171 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:02:50.172 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:02:50.172 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:02:50.172 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:02:50.174 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:02:50.174 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:02:50.174 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:02:50.174 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:02:50.174 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:02:50.174 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:02:50.175 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:02:50.176 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:02:50.176 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:02:50.176 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:50.176 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:02:50.176 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:02:50.282 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 10/21/2024 02:02:50.282 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_routers' 10/21/2024 02:02:50.282 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 10/21/2024 02:02:50.282 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_target_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:02:50.283 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 10/21/2024 02:02:50.284 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_aggregate_back_refs' 10/21/2024 02:02:50.284 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 10/21/2024 02:02:50.284 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_policy_back_refs' 10/21/2024 02:02:50.284 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 10/21/2024 02:02:50.284 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_back_refs' 10/21/2024 02:02:50.287 7fcafeea78d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "fc2ada3f-5fde-4d9a-8988-caf7a780154c", "ref-fq-name": ["juniper-qfx10002-60c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.287 7fcafeea78d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "fc2ada3f-5fde-4d9a-8988-caf7a780154c", "ref-fq-name": ["juniper-qfx10002-60c"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.295 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-d4f32e0d-bf1e-4aef-929e-8e62b2b70914', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:50.339 7fcafee4fd68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/global-system-config/953d4841-c203-4a7e-b905-387930676988 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "953d4841-c203-4a7e-b905-387930676988", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.0.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.339 7fcafee4fd68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 953d4841-c203-4a7e-b905-387930676988 object_type = global_system_config identifier_name = default-global-system-config url = https://10.0.0.30:8082/global-system-config/953d4841-c203-4a7e-b905-387930676988 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"global-system-config": {"uuid": "953d4841-c203-4a7e-b905-387930676988", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.0.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.355 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-1f5c6403-5c20-49c9-bf0f-cece2870e8fc', 'type': 'global_system_config', 'uuid': '953d4841-c203-4a7e-b905-387930676988'} 10/21/2024 02:02:50.453 7fcafec8a048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "dcd8963a-a518-4bdc-9915-36d2b4af6751", "ref-fq-name": ["juniper-qfx10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.453 7fcafec8a048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "dcd8963a-a518-4bdc-9915-36d2b4af6751", "ref-fq-name": ["juniper-qfx10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.454 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'] not found in DB: Unknown id: virtual_router default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:02:50.454 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: virtual_router default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 10/21/2024 02:02:50.459 7fcaff060e10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/virtual-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.459 7fcaff060e10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/virtual-routers operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.0.0.30", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-juju-os-439-1"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.465 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-cb861dd6-91de-4a21-85eb-1143952c4cf6', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:50.498 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'obj_dict': {'display_name': 'cn-jenkins-deploy-platform-juju-os-439-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'id_perms': {'created': '2024-10-21T02:02:50.487784', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:50.487784', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11250257559243180076, 'uuid_mslong': 7046303228851732579}}, 'parent_type': 'global-system-config', 'parent_uuid': '953d4841-c203-4a7e-b905-387930676988', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '61c97f74-2765-4063-9c20-f1a4ca57c82c', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.30'}, 'oper': 'CREATE', 'request-id': 'req-c03c2922-e04a-461e-93d6-d9ce5b322425', 'type': 'virtual_router', 'uuid': '61c97f74-2765-4063-9c20-f1a4ca57c82c'} 10/21/2024 02:02:50.500 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 10/21/2024 02:02:50.583 7fcafedd9978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:02:50.595 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 10/21/2024 02:02:50.596 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interfaces' 10/21/2024 02:02:50.596 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 10/21/2024 02:02:50.597 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'network_ipam_refs' 10/21/2024 02:02:50.597 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 10/21/2024 02:02:50.597 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'sub_cluster_refs' 10/21/2024 02:02:50.597 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 10/21/2024 02:02:50.597 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_refs' 10/21/2024 02:02:50.598 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 10/21/2024 02:02:50.598 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:50.598 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 10/21/2024 02:02:50.598 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:02:50.598 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 10/21/2024 02:02:50.599 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:02:50.599 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 10/21/2024 02:02:50.599 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'provider_attachment_back_refs' 10/21/2024 02:02:50.619 7fcafee5d588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "76383631-b4f7-4e01-9f6c-6891cf5fb220", "ref-fq-name": ["juniper-qfx10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.620 7fcafee5d588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "76383631-b4f7-4e01-9f6c-6891cf5fb220", "ref-fq-name": ["juniper-qfx10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.631 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-d436ae5b-4ec0-4bf7-aaa5-981469228d7b', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:50.638 7fcafedd9978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:02:50.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:50.747 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field access_control_lists in resource virtual-network: 'access_control_lists' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'access_control_lists' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field floating_ip_pools in resource virtual-network: 'floating_ip_pools' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'floating_ip_pools' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alias_ip_pools in resource virtual-network: 'alias_ip_pools' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alias_ip_pools' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instances in resource virtual-network: 'routing_instances' 10/21/2024 02:02:50.830 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instances' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bridge_domains in resource virtual-network: 'bridge_domains' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bridge_domains' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_object_refs in resource virtual-network: 'security_logging_object_refs' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'security_logging_object_refs' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_refs in resource virtual-network: 'qos_config_refs' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_refs' 10/21/2024 02:02:50.831 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-network: 'network_ipam_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'network_ipam_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_policy_refs in resource virtual-network: 'network_policy_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'network_policy_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_refs in resource virtual-network: 'virtual_network_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_network_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_health_check_refs in resource virtual-network: 'service_health_check_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_health_check_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_table_refs in resource virtual-network: 'route_table_refs' 10/21/2024 02:02:50.832 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_table_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field multicast_policy_refs in resource virtual-network: 'multicast_policy_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'multicast_policy_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgpvpn_refs in resource virtual-network: 'bgpvpn_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgpvpn_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_map_refs in resource virtual-network: 'intent_map_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_map_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_refs in resource virtual-network: 'routing_policy_refs' 10/21/2024 02:02:50.833 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_policy_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-network: 'tag_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_back_refs in resource virtual-network: 'virtual_network_back_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_network_back_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource virtual-network: 'virtual_machine_interface_back_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-network: 'instance_ip_back_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:02:50.834 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-network: 'physical_router_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_tuple_back_refs in resource virtual-network: 'port_tuple_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'port_tuple_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource virtual-network: 'logical_router_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'logical_router_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_node_back_refs in resource virtual-network: 'flow_node_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_node_back_refs' 10/21/2024 02:02:50.835 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field firewall_rule_back_refs in resource virtual-network: 'firewall_rule_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'firewall_rule_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnect_back_refs in resource virtual-network: 'data_center_interconnect_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnect_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabric_back_refs in resource virtual-network: 'fabric_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabric_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field host_based_service_back_refs in resource virtual-network: 'host_based_service_back_refs' 10/21/2024 02:02:50.836 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'host_based_service_back_refs' 10/21/2024 02:02:50.843 7fcafeca3eb8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "040b408f-c8ea-4e56-b005-47a99e744925", "ref-fq-name": ["juniper-vqfx-10000"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.844 7fcafeca3eb8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "hardware", "ref-uuid": "040b408f-c8ea-4e56-b005-47a99e744925", "ref-fq-name": ["juniper-vqfx-10000"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.851 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-70bd1930-8bf3-4bdb-b28e-0b52955ebef1', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:50.889 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1', 'vhost0'] not found in DB: Unknown id: virtual_machine_interface default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 10/21/2024 02:02:50.889 7fcafede8630 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: virtual_machine_interface default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 10/21/2024 02:02:50.897 7fcafefcc240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 url = https://10.0.0.30:8082/virtual-machine-interfaces operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "1e338ece-fda8-4842-aa92-7ce58d0af31f"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.897 7fcafefcc240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 url = https://10.0.0.30:8082/virtual-machine-interfaces operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "1e338ece-fda8-4842-aa92-7ce58d0af31f"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:50.926 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1', 'vhost0'], 'id_perms': {'created': '2024-10-21T02:02:50.913670', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:50.913670', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11253581965058119022, 'uuid_mslong': 7076157520567945856}}, 'parent_type': 'virtual-router', 'parent_uuid': '61c97f74-2765-4063-9c20-f1a4ca57c82c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '62338fc6-1c29-4a80-9c2c-c12c5608156e', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:62:33:8f:c6:1c']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '1e338ece-fda8-4842-aa92-7ce58d0af31f'}]}, 'oper': 'CREATE', 'request-id': 'req-ae3a5e16-8cd1-46c8-b2bf-c76e0ab1e9cb', 'type': 'virtual_machine_interface', 'uuid': '62338fc6-1c29-4a80-9c2c-c12c5608156e'} 10/21/2024 02:02:50.992 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 10/21/2024 02:02:51.005 7fcafec89c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 561b7c53-af63-41b3-9c25-ec39072a7243 object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.30:8082/access-control-list/561b7c53-af63-41b3-9c25-ec39072a7243 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": "561b7c53-af63-41b3-9c25-ec39072a7243", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": -3116356454269660385}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.005 7fcafec89c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 561b7c53-af63-41b3-9c25-ec39072a7243 object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = https://10.0.0.30:8082/access-control-list/561b7c53-af63-41b3-9c25-ec39072a7243 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"access-control-list": {"uuid": "561b7c53-af63-41b3-9c25-ec39072a7243", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": -3116356454269660385}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.010 7fcafef5de10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 62338fc6-1c29-4a80-9c2c-c12c5608156e object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 10/21/2024 02:02:51.010 7fcafef5de10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 62338fc6-1c29-4a80-9c2c-c12c5608156e object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 10/21/2024 02:02:51.027 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-a526f93d-15fd-4264-90cf-7855110bb7b2', 'type': 'access_control_list', 'uuid': '561b7c53-af63-41b3-9c25-ec39072a7243'} 10/21/2024 02:02:51.029 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-ae3a5e16-8cd1-46c8-b2bf-c76e0ab1e9cb', 'type': 'virtual_machine_interface', 'uuid': '62338fc6-1c29-4a80-9c2c-c12c5608156e'} 10/21/2024 02:02:51.061 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "baaaa25f-84dc-45c1-ac5c-7a1e76d7f733", "ref-fq-name": ["juniper-mx80"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.062 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "baaaa25f-84dc-45c1-ac5c-7a1e76d7f733", "ref-fq-name": ["juniper-mx80"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.073 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-36eed499-ca6b-448f-9d74-38f8532054a2', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:51.228 7fcafec62978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "c8a7536d-d1bc-468f-9b0b-c4a3d672a821", "ref-fq-name": ["juniper-mx80-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.228 7fcafec62978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "c8a7536d-d1bc-468f-9b0b-c4a3d672a821", "ref-fq-name": ["juniper-mx80-48t"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.237 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-769a88e7-ede8-43e0-98de-5123f2eeea27', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:51.390 7fcafefe1438 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "36ea3102-6191-4098-a0a2-385943488b43", "ref-fq-name": ["juniper-mx204"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.391 7fcafefe1438 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "36ea3102-6191-4098-a0a2-385943488b43", "ref-fq-name": ["juniper-mx204"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.399 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2f4fc96e-1709-4fef-8c30-2dda7a5d24c0', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:51.555 7fcafed9fe10 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "68f5901d-dfa3-441f-ad5b-4dce5494271a", "ref-fq-name": ["juniper-mx240"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.555 7fcafed9fe10 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "68f5901d-dfa3-441f-ad5b-4dce5494271a", "ref-fq-name": ["juniper-mx240"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.563 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-734bc4c3-c695-4157-9cd4-22671b6638a6', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:51.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:51.716 7fcaff02b780 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "c70e39fd-5c67-4e09-985a-e6efe9a0b855", "ref-fq-name": ["juniper-mx480"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.717 7fcaff02b780 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "c70e39fd-5c67-4e09-985a-e6efe9a0b855", "ref-fq-name": ["juniper-mx480"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.725 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-7170b84c-0a4f-4a53-b3a1-5c86aeeb28cb', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:51.886 7fcafedea588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "5d574eb7-68f8-4730-87e1-670efa8417ed", "ref-fq-name": ["juniper-mx960"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.886 7fcafedea588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "5d574eb7-68f8-4730-87e1-670efa8417ed", "ref-fq-name": ["juniper-mx960"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:51.897 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-c2f21bab-7e42-4116-bacb-bbce826836eb', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.038 7fcaff02b828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "9ec41dd1-e8dc-43ae-99b6-1fe26eb26b9f", "ref-fq-name": ["juniper-mx2008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.038 7fcaff02b828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "9ec41dd1-e8dc-43ae-99b6-1fe26eb26b9f", "ref-fq-name": ["juniper-mx2008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.046 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-0c6408c6-4091-40d6-970a-b62ccba1ab1b', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.191 7fcafec76240 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "f094ba9b-31f8-4772-9fb3-c26a1ef4be3d", "ref-fq-name": ["juniper-mx2010"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.192 7fcafec76240 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "f094ba9b-31f8-4772-9fb3-c26a1ef4be3d", "ref-fq-name": ["juniper-mx2010"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.199 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-f8a51ed1-5c07-4d21-a06a-957344d088f4', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.350 7fcafeeee4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "9f0d9221-3943-420e-9a02-c847fcf5cf59", "ref-fq-name": ["juniper-mx2020"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.350 7fcafeeee4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "9f0d9221-3943-420e-9a02-c847fcf5cf59", "ref-fq-name": ["juniper-mx2020"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.358 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-6753d4fa-96ec-4fbc-8d6b-6eeeb6b51912', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.513 7fcafee9f4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "b13e45ec-d4e3-4345-ba7d-05b937fda6bf", "ref-fq-name": ["juniper-mx10003"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.514 7fcafee9f4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "b13e45ec-d4e3-4345-ba7d-05b937fda6bf", "ref-fq-name": ["juniper-mx10003"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.522 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-62256751-2b33-4b82-afc9-5bb6dd9a35da', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.679 7fcafee3f8d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "4bdef155-92ef-4ba8-9cb9-c6912a6a5c70", "ref-fq-name": ["juniper-jnp10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.679 7fcafee3f8d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "4bdef155-92ef-4ba8-9cb9-c6912a6a5c70", "ref-fq-name": ["juniper-jnp10008"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.687 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-9723d26d-6e46-47d7-8d87-0e6a04da3556', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:52.835 7fcafef58390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "3fa0ca1a-4339-4127-843d-45bf02c6edc5", "ref-fq-name": ["juniper-jnp10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.835 7fcafef58390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "3fa0ca1a-4339-4127-843d-45bf02c6edc5", "ref-fq-name": ["juniper-jnp10016"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.844 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-71066fd9-2a96-43d0-8599-a75410951240', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:52.987 7fcafef08d68 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "9495a0fd-bdda-4160-89e8-80e352a87f23", "ref-fq-name": ["juniper-vmx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.987 7fcafef08d68 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "hardware", "ref-uuid": "9495a0fd-bdda-4160-89e8-80e352a87f23", "ref-fq-name": ["juniper-vmx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:52.996 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-9a7d602f-3b0e-4c08-b2b2-6d74bf216eae', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:53.139 7fcafec2b4e0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "2c7ef77b-a2b9-4a1c-a0bf-e310467cf703", "ref-fq-name": ["juniper-srx5400"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.139 7fcafec2b4e0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "2c7ef77b-a2b9-4a1c-a0bf-e310467cf703", "ref-fq-name": ["juniper-srx5400"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.151 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-f329de5c-b636-4b3a-99f1-b7213d265285', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:53.306 7fcaff0d3c18 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "bf3332cd-0e0e-4928-b0ab-d5a788a6c348", "ref-fq-name": ["juniper-srx5600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.306 7fcaff0d3c18 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "bf3332cd-0e0e-4928-b0ab-d5a788a6c348", "ref-fq-name": ["juniper-srx5600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.317 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-b48f4abf-0137-464f-81e0-7380e96f8916', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:53.477 7fcafec39ac8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "3483eb1e-3560-47b2-8cab-873a48a1fe2d", "ref-fq-name": ["juniper-srx4600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.477 7fcafec39ac8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "3483eb1e-3560-47b2-8cab-873a48a1fe2d", "ref-fq-name": ["juniper-srx4600"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.486 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-30303110-aaea-4aa0-af8b-fc0ed00ebf07', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:53.641 7fcafec892e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "2a549b48-1880-451c-a9de-5fabc0bb5e80", "ref-fq-name": ["juniper-srx4100"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.641 7fcafec892e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "2a549b48-1880-451c-a9de-5fabc0bb5e80", "ref-fq-name": ["juniper-srx4100"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.656 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-4e9d2423-41f9-4fa7-bf42-1246040ad3c9', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:53.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:53.804 7fcafec62588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "e0533115-7882-417e-90f1-ca411fa8d6e6", "ref-fq-name": ["juniper-srx1500"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.804 7fcafec62588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "e0533115-7882-417e-90f1-ca411fa8d6e6", "ref-fq-name": ["juniper-srx1500"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.816 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-f9d45208-1d9c-49c6-8c4c-c8810f312cd1', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:53.963 7fcafec4e2e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "38e9cda6-6d95-4118-a8cd-fa443de1d33e", "ref-fq-name": ["juniper-srx240h-poe"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.963 7fcafec4e2e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "38e9cda6-6d95-4118-a8cd-fa443de1d33e", "ref-fq-name": ["juniper-srx240h-poe"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:53.978 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-4947c873-e315-4d27-a83b-9fa1282f840b', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:54.130 7fcafec62048 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "92d6497c-c9bc-4ea0-b25a-fde44f2aec54", "ref-fq-name": ["juniper-vsrx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.131 7fcafec62048 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "92d6497c-c9bc-4ea0-b25a-fde44f2aec54", "ref-fq-name": ["juniper-vsrx"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.156 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-ff1b0984-0833-4791-b011-cdd953a291d2', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:54.317 7fcafec4e828 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "4407b548-96a9-4b61-8e4f-e14e0f1809f3", "ref-fq-name": ["juniper-srx5800"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.317 7fcafec4e828 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "4407b548-96a9-4b61-8e4f-e14e0f1809f3", "ref-fq-name": ["juniper-srx5800"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.326 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-04ad3bf0-8601-44c8-af42-8c1f53a9c6b6', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:54.479 7fcafec3b588 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "7db6d4d5-3c20-45ef-b430-10184855bd84", "ref-fq-name": ["juniper-srx4200"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.479 7fcafec3b588 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "hardware", "ref-uuid": "7db6d4d5-3c20-45ef-b430-10184855bd84", "ref-fq-name": ["juniper-srx4200"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.486 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-2f3d57a1-6efd-46a7-b087-47fbf49375a2', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:54.632 7fcaff0d32e8 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.633 7fcaff0d32e8 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "physical-role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.639 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-97cb1c9f-2583-4a3f-9aee-a3d2fec586aa', 'type': 'node_profile', 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'} 10/21/2024 02:02:54.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:54.797 7fcafebdcb70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "overlay-role", "ref-uuid": "713c001c-6be8-4c84-b19f-f8ecebf8ef18", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.798 7fcafebdcb70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "overlay-role", "ref-uuid": "713c001c-6be8-4c84-b19f-f8ecebf8ef18", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.798 7fcaff0608d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7046303228851732579, "uuid_lslong": 11250257559243180076}, "enable": true, "created": "2024-10-21T02:02:50.487784", "last_modified": "2024-10-21T02:02:50.487784", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "61c97f74-2765-4063-9c20-f1a4ca57c82c"virtual_router_dpdk_enabled : falsevirtual_router_ip_address : "10.0.0.30" } deleted = False >> 10/21/2024 02:02:54.799 7fcaff0608d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.800 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.800 7fcaff0608d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 elements = { display_name : "vhost0"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1", "vhost0"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7076157520567945856, "uuid_lslong": 11253581965058119022}, "enable": true, "created": "2024-10-21T02:02:50.913670", "last_modified": "2024-10-21T02:02:50.913670", "description": null, "user_visible": true, "creator": null}parent_type : "virtual-router"parent_uuid : "61c97f74-2765-4063-9c20-f1a4ca57c82c"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "62338fc6-1c29-4a80-9c2c-c12c5608156e"virtual_machine_interface_disable_policy : truevirtual_machine_interface_mac_addresses : {"mac_address": ["02:62:33:8f:c6:1c"]}virtual_network_refs : [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "1e338ece-fda8-4842-aa92-7ce58d0af31f"}] } deleted = False >> 10/21/2024 02:02:54.801 7fcaff0608d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.801 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.801 7fcaff0608d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 elements = { display_name : "vhost0"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1", "vhost0"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7076157520567945856, "uuid_lslong": 11253581965058119022}, "enable": true, "created": "2024-10-21T02:02:50.913670", "last_modified": "2024-10-21T02:02:51.016340", "description": null, "user_visible": true, "creator": null}parent_type : "virtual-router"parent_uuid : "61c97f74-2765-4063-9c20-f1a4ca57c82c"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}routing_instance_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "ip-fabric"], "attr": {"direction": "both", "vlan_tag": null, "src_mac": null, "dst_mac": null, "mpls_label": null, "service_chain_address": null, "ipv6_service_chain_address": null, "protocol": null}, "uuid": "04b5002c-41a0-4bf2-a878-358fac405bef"}]uuid : "62338fc6-1c29-4a80-9c2c-c12c5608156e"virtual_machine_interface_disable_policy : truevirtual_machine_interface_mac_addresses : {"mac_address": ["02:62:33:8f:c6:1c"]}virtual_network_refs : [{"to": ["default-domain", "default-project", "ip-fabric"], "attr": null, "uuid": "1e338ece-fda8-4842-aa92-7ce58d0af31f"}] } deleted = False >> 10/21/2024 02:02:54.801 7fcaff0608d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:02:54.801 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:02:54.801 7fcaff0608d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:02:54.802 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.802 7fcaff0608d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:02:54.802 7fcaff0608d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.802 7fcaff0608d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.802 7fcaff0608d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:02:54.802 7fcaff0608d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:02:54.811 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-f2484869-c475-4d8c-8aeb-1402d865de89', 'type': 'node_profile', 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'} 10/21/2024 02:02:54.964 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "overlay-role", "ref-uuid": "713c001c-6be8-4c84-b19f-f8ecebf8ef18", "ref-fq-name": ["default-global-system-config", "erb-ucast-gateway"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:54.972 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-6f3ff561-b400-4f74-91bd-71c427eb9a31', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:55.130 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 43c449f6-ee24-4e62-91b8-2d98ddcf16e3 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "43c449f6-ee24-4e62-91b8-2d98ddcf16e3", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:55.139 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-5a131747-259e-4ea0-b3c6-2e13bdca9461', 'type': 'node_profile', 'uuid': '43c449f6-ee24-4e62-91b8-2d98ddcf16e3'} 10/21/2024 02:02:55.283 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 624902b2-87ef-4e3a-98c5-5a356ebf0788 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "624902b2-87ef-4e3a-98c5-5a356ebf0788", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:55.293 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-8aa3d0d1-4077-46fa-9d4c-52f2775a8294', 'type': 'node_profile', 'uuid': '624902b2-87ef-4e3a-98c5-5a356ebf0788'} 10/21/2024 02:02:55.440 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = eebf520a-2ed6-48e9-9676-56c8cae13e8b object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5120 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "eebf520a-2ed6-48e9-9676-56c8cae13e8b", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:55.448 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-71d6e80c-1075-48c6-aa23-4b484654af39', 'type': 'node_profile', 'uuid': 'eebf520a-2ed6-48e9-9676-56c8cae13e8b'} 10/21/2024 02:02:55.589 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0ab14e22-8b06-45b7-8723-202a66bcfc46 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "0ab14e22-8b06-45b7-8723-202a66bcfc46", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:55.598 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-c5c8bfe1-da41-42c4-9df5-f822b0ee59c9', 'type': 'node_profile', 'uuid': '0ab14e22-8b06-45b7-8723-202a66bcfc46'} 10/21/2024 02:02:55.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:55.744 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 80d8cb87-b33e-490d-a549-5609a02b5005 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k-lean url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "80d8cb87-b33e-490d-a549-5609a02b5005", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:55.776 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-4d6162f9-c7b3-4294-b3df-fedcdd126b07', 'type': 'node_profile', 'uuid': '80d8cb87-b33e-490d-a549-5609a02b5005'} 10/21/2024 02:02:55.925 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 01e23bb6-f0fc-4f7d-b340-93ec435a6249 object_type = node_profile identifier_name = default-global-system-config:juniper-qfx10k url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "01e23bb6-f0fc-4f7d-b340-93ec435a6249", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:55.933 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-02697b13-472a-44dd-8368-120aa3096483', 'type': 'node_profile', 'uuid': '01e23bb6-f0fc-4f7d-b340-93ec435a6249'} 10/21/2024 02:02:56.081 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7d587b8b-0b07-4329-82e3-723977466375 object_type = node_profile identifier_name = default-global-system-config:juniper-mx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "7d587b8b-0b07-4329-82e3-723977466375", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:56.090 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-aff24cc8-2fdb-4c82-85ae-2171f239d5df', 'type': 'node_profile', 'uuid': '7d587b8b-0b07-4329-82e3-723977466375'} 10/21/2024 02:02:56.236 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37ea506b-90be-4152-9592-45d8d016c4e4 object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "node-profile", "uuid": "37ea506b-90be-4152-9592-45d8d016c4e4", "ref-type": "job_template", "ref-uuid": "b1e00e2c-9e80-4150-9393-a065225f8973", "ref-fq-name": ["default-global-system-config", "fabric_config_template"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:56.243 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-e81e33d2-9774-46ed-847d-68323121e7f8', 'type': 'node_profile', 'uuid': '37ea506b-90be-4152-9592-45d8d016c4e4'} 10/21/2024 02:02:56.399 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d2ba2499-3f11-4b20-8594-2d321bd71e4b object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-1 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "telemetry-profile", "uuid": "d2ba2499-3f11-4b20-8594-2d321bd71e4b", "ref-type": "sflow-profile", "ref-uuid": "fd7d69a3-be06-4e63-89c5-a5c323046a24", "ref-fq-name": ["default-domain", "default-project", "sflow-all-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:56.413 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-bfd38281-0376-43be-8732-8625f4bbf248', 'type': 'telemetry_profile', 'uuid': 'd2ba2499-3f11-4b20-8594-2d321bd71e4b'} 10/21/2024 02:02:56.557 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 25070f69-2d82-464b-be11-7a36400233a5 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "telemetry-profile", "uuid": "25070f69-2d82-464b-be11-7a36400233a5", "ref-type": "sflow-profile", "ref-uuid": "bb362929-b71d-408e-beba-d926aba0ed6b", "ref-fq-name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:56.567 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-d7e117e8-ccd7-4332-965b-2711c40f176e', 'type': 'telemetry_profile', 'uuid': '25070f69-2d82-464b-be11-7a36400233a5'} 10/21/2024 02:02:56.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:56.718 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 837d43f3-177f-4948-8187-fce17d6cbefa object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-3 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "telemetry-profile", "uuid": "837d43f3-177f-4948-8187-fce17d6cbefa", "ref-type": "sflow-profile", "ref-uuid": "cc65df5d-5d42-41d9-963c-e8b935262b88", "ref-fq-name": ["default-domain", "default-project", "sflow-access-interfaces"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:56.733 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-a81cf143-fccb-4e68-a75d-f36a060f1f16', 'type': 'telemetry_profile', 'uuid': '837d43f3-177f-4948-8187-fce17d6cbefa'} 10/21/2024 02:02:56.886 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 931c562d-b4f9-41cc-b189-d88f38863a82 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-4 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "telemetry-profile", "uuid": "931c562d-b4f9-41cc-b189-d88f38863a82", "ref-type": "grpc-profile", "ref-uuid": "829a3c05-45a4-494e-ba1e-1a9fe4a84786", "ref-fq-name": ["default-domain", "default-project", "grpc-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:56.899 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-6c9bcf67-7db7-4a5a-a064-8f3eb54c811c', 'type': 'telemetry_profile', 'uuid': '931c562d-b4f9-41cc-b189-d88f38863a82'} 10/21/2024 02:02:57.049 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 84df5785-b9e2-4c53-9a7e-9f4b81de0723 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "telemetry-profile", "uuid": "84df5785-b9e2-4c53-9a7e-9f4b81de0723", "ref-type": "snmp-profile", "ref-uuid": "4620dc81-5d85-4b4d-8f7d-9c707c58f8fb", "ref-fq-name": ["default-domain", "default-project", "snmp-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:57.062 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-238e90f7-574e-419f-99cb-7ab9b6540e63', 'type': 'telemetry_profile', 'uuid': '84df5785-b9e2-4c53-9a7e-9f4b81de0723'} 10/21/2024 02:02:57.211 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 29e08937-aa62-4bbc-914b-832747f49502 object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-6 url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "telemetry-profile", "uuid": "29e08937-aa62-4bbc-914b-832747f49502", "ref-type": "netconf-profile", "ref-uuid": "73caa694-d72a-45dd-b1fb-64b90d3da013", "ref-fq-name": ["default-domain", "default-project", "netconf-default-profile"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:57.224 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-db4b013e-ee7a-454a-b714-b502341f303e', 'type': 'telemetry_profile', 'uuid': '29e08937-aa62-4bbc-914b-832747f49502'} 10/21/2024 02:02:57.376 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f99ac35e-5006-43c0-92f3-6dc3055e3b95 object_type = device_functional_group identifier_name = default-domain:default-project:L2-Server-Leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "f99ac35e-5006-43c0-92f3-6dc3055e3b95", "ref-type": "physical_role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:57.388 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-962827b8-780b-4b7a-ba76-41b47f990624', 'type': 'device_functional_group', 'uuid': 'f99ac35e-5006-43c0-92f3-6dc3055e3b95'} 10/21/2024 02:02:57.546 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 9e83d026-e0cb-412a-87a8-b0a57d7c1b61 object_type = device_functional_group identifier_name = default-domain:default-project:L3-Storage-Leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "9e83d026-e0cb-412a-87a8-b0a57d7c1b61", "ref-type": "physical_role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:57.557 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-741e95f6-f46f-4743-8a92-266f1d858071', 'type': 'device_functional_group', 'uuid': '9e83d026-e0cb-412a-87a8-b0a57d7c1b61'} 10/21/2024 02:02:57.704 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1e8b1d8f-38fc-45ff-be3f-012e7ee312ca object_type = device_functional_group identifier_name = default-domain:default-project:L3-Gateway-Spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "1e8b1d8f-38fc-45ff-be3f-012e7ee312ca", "ref-type": "physical_role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:57.713 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-785feb6d-332c-4ecd-a026-39409edce23e', 'type': 'device_functional_group', 'uuid': '1e8b1d8f-38fc-45ff-be3f-012e7ee312ca'} 10/21/2024 02:02:57.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:57.857 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = a21b53c6-f38c-4d33-a869-b803ef09bc87 object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "a21b53c6-f38c-4d33-a869-b803ef09bc87", "ref-type": "physical_role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:57.871 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-02b23950-0233-4959-bbe8-e38181aedf1a', 'type': 'device_functional_group', 'uuid': 'a21b53c6-f38c-4d33-a869-b803ef09bc87'} 10/21/2024 02:02:58.021 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b5ae0ec5-6f1a-4fa7-9e7d-0364350c3032 object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "b5ae0ec5-6f1a-4fa7-9e7d-0364350c3032", "ref-type": "physical_role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.034 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-271319d5-d9d9-4b97-99b0-07bb953ddb2e', 'type': 'device_functional_group', 'uuid': 'b5ae0ec5-6f1a-4fa7-9e7d-0364350c3032'} 10/21/2024 02:02:58.184 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6964cd07-2472-4910-91d8-4d00c091404d object_type = device_functional_group identifier_name = default-domain:default-project:Centrally-Routed-Border-Spine-With-Optimized-Multicast url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "6964cd07-2472-4910-91d8-4d00c091404d", "ref-type": "physical_role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.196 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-38d4d84d-b6be-47f1-bf0e-1f24f19fb294', 'type': 'device_functional_group', 'uuid': '6964cd07-2472-4910-91d8-4d00c091404d'} 10/21/2024 02:02:58.357 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7610cd1c-4698-4c25-b7b8-c8f725e70a0f object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "7610cd1c-4698-4c25-b7b8-c8f725e70a0f", "ref-type": "physical_role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.374 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-56931625-857e-4fb9-b9dc-c17f22ceb0a9', 'type': 'device_functional_group', 'uuid': '7610cd1c-4698-4c25-b7b8-c8f725e70a0f'} 10/21/2024 02:02:58.528 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2a5ad2ee-137c-4982-8d0b-6769a04687f2 object_type = device_functional_group identifier_name = default-domain:default-project:Border-Leaf-in-Edge-Routed url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "2a5ad2ee-137c-4982-8d0b-6769a04687f2", "ref-type": "physical_role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.537 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-257bedca-0572-4478-befc-e11f2c838ecf', 'type': 'device_functional_group', 'uuid': '2a5ad2ee-137c-4982-8d0b-6769a04687f2'} 10/21/2024 02:02:58.693 7fcaff0b7c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 75697344-eefc-4ed3-9289-608632a6227b object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "75697344-eefc-4ed3-9289-608632a6227b", "ref-type": "physical_role", "ref-uuid": "dbc3f0d4-c0f3-4ae7-b5cd-7f0e486acbab", "ref-fq-name": ["default-global-system-config", "leaf"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.704 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-6b0eff13-98a5-4cec-989c-2700144b4512', 'type': 'device_functional_group', 'uuid': '75697344-eefc-4ed3-9289-608632a6227b'} 10/21/2024 02:02:58.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:02:58.799 7fcaff0b36d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:02:58.860 7fcafef088d0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c18b6409-64dc-4cc3-939c-099c2e1df999 object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "c18b6409-64dc-4cc3-939c-099c2e1df999", "ref-type": "physical_role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.860 7fcafef088d0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c18b6409-64dc-4cc3-939c-099c2e1df999 object_type = device_functional_group identifier_name = default-domain:default-project:Lean-Spine-with-Route-Reflector url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"type": "device-functional-group", "uuid": "c18b6409-64dc-4cc3-939c-099c2e1df999", "ref-type": "physical_role", "ref-uuid": "9212edc3-6ba3-4489-a982-913f39090353", "ref-fq-name": ["default-global-system-config", "spine"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.874 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-d8030e5c-1a37-42fe-b2b2-7324fe501978', 'type': 'device_functional_group', 'uuid': 'c18b6409-64dc-4cc3-939c-099c2e1df999'} 10/21/2024 02:02:58.922 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'] not found in DB: Unknown id: network_ipam default-domain:default-project:_internal_ipam_ipv6_link_local 10/21/2024 02:02:58.923 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: network_ipam default-domain:default-project:_internal_ipam_ipv6_link_local 10/21/2024 02:02:58.930 7fcafec37978 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = network_ipam identifier_name = default-domain:default-project:_internal_ipam_ipv6_link_local url = https://10.0.0.30:8082/network-ipams operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"network-ipam": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "parent_type": "project", "ipam_subnet_method": "user-defined-subnet", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_ipam_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.930 7fcafec37978 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = network_ipam identifier_name = default-domain:default-project:_internal_ipam_ipv6_link_local url = https://10.0.0.30:8082/network-ipams operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"network-ipam": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "parent_type": "project", "ipam_subnet_method": "user-defined-subnet", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_ipam_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:58.951 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_ipam_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'id_perms': {'created': '2024-10-21T02:02:58.943220', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:58.943220', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11606320563139146323, 'uuid_mslong': 4881561996630312286}}, 'ipam_subnet_method': 'user-defined-subnet', 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '43becac5-b632-455e-a111-ef0f2b387253'}, 'oper': 'CREATE', 'request-id': 'req-c398ff23-604e-4fef-ae2d-19aa200dfc0a', 'type': 'network_ipam', 'uuid': '43becac5-b632-455e-a111-ef0f2b387253'} 10/21/2024 02:02:59.002 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'] not found in DB: Unknown id: virtual_network default-domain:default-project:_internal_vn_ipv6_link_local 10/21/2024 02:02:59.002 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: virtual_network default-domain:default-project:_internal_vn_ipv6_link_local 10/21/2024 02:02:59.008 7fcafee3fcc0 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_network identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local url = https://10.0.0.30:8082/virtual-networks operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"virtual-network": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local"], "parent_type": "project", "address_allocation_mode": "user-defined-subnet-only", "network_ipam_refs": [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": null, "subnet_uuid": "986b4d92-8f50-11ef-8b39-76fafadcd1c7", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "43becac5-b632-455e-a111-ef0f2b387253"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:59.008 7fcafee3fcc0 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_network identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local url = https://10.0.0.30:8082/virtual-networks operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-device-manager remote_ip = 10.0.0.30 body = {"virtual-network": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local"], "parent_type": "project", "address_allocation_mode": "user-defined-subnet-only", "network_ipam_refs": [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": null, "subnet_uuid": "986b4d92-8f50-11ef-8b39-76fafadcd1c7", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "43becac5-b632-455e-a111-ef0f2b387253"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:59.101 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'obj_dict': {'address_allocation_mode': 'user-defined-subnet-only', 'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2024-10-21T02:02:59.037004', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:59.037004', 'permissions': {'group': 'reader', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11186655279188154269, 'uuid_mslong': 9994715591917062857}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'addr_from_start': True, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': 'fe80::1', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': 'fe80::2', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': 'fe80::', 'ip_prefix_len': 64}, 'subnet_name': None, 'subnet_uuid': '986b4d92-8f50-11ef-8b39-76fafadcd1c7', 'subscriber_tag': None, 'vlan_tag': None}]}, 'to': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'uuid': '43becac5-b632-455e-a111-ef0f2b387253'}], 'parent_type': 'project', 'parent_uuid': 'c73bc058-a0d8-418e-a889-1f0a1c75ce6f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8ab45ce0-6746-4ac9-9b3e-fbb4fcc2179d', 'virtual_network_network_id': 5}, 'oper': 'CREATE', 'request-id': 'req-f7e12782-a972-4291-a6ff-274bfcb2a980', 'type': 'virtual_network', 'uuid': '8ab45ce0-6746-4ac9-9b3e-fbb4fcc2179d'} 10/21/2024 02:02:59.102 7fcaff777588 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 10/21/2024 02:02:59.107 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'] not found in DB: Unknown id: routing_instance default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local 10/21/2024 02:02:59.107 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: routing_instance default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local 10/21/2024 02:02:59.113 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = http://127.0.0.1/routing-instances operation = post body = {"routing-instance": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local", "_internal_vn_ipv6_link_local"], "parent_type": "virtual-network", "routing_instance_is_default": true, "routing_instance_has_pnf": false, "routing_instance_fabric_snat": false, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain >> 10/21/2024 02:02:59.113 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = http://127.0.0.1/routing-instances operation = post body = {"routing-instance": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_vn_ipv6_link_local", "_internal_vn_ipv6_link_local"], "parent_type": "virtual-network", "routing_instance_is_default": true, "routing_instance_has_pnf": false, "routing_instance_fabric_snat": false, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_vn_ipv6_link_local"}} domain = default-domain >> 10/21/2024 02:02:59.139 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2024-10-21T02:02:59.125891', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:59.125891', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10740278856551729220, 'uuid_mslong': 1640313229253103536}}, 'parent_type': 'virtual-network', 'parent_uuid': '8ab45ce0-6746-4ac9-9b3e-fbb4fcc2179d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '16c39030-f601-4fb0-950d-22b731678844'}, 'oper': 'CREATE', 'request-id': 'req-f7e12782-a972-4291-a6ff-274bfcb2a980', 'type': 'routing_instance', 'uuid': '16c39030-f601-4fb0-950d-22b731678844'} 10/21/2024 02:02:59.393 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabric_namespaces in resource fabric: 'fabric_namespaces' 10/21/2024 02:02:59.393 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabric_namespaces' 10/21/2024 02:02:59.393 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_groups in resource fabric: 'virtual_port_groups' 10/21/2024 02:02:59.394 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_port_groups' 10/21/2024 02:02:59.394 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_map_refs in resource fabric: 'intent_map_refs' 10/21/2024 02:02:59.394 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_map_refs' 10/21/2024 02:02:59.394 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_network_refs in resource fabric: 'virtual_network_refs' 10/21/2024 02:02:59.394 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_network_refs' 10/21/2024 02:02:59.394 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profile_refs in resource fabric: 'node_profile_refs' 10/21/2024 02:02:59.395 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profile_refs' 10/21/2024 02:02:59.395 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource fabric: 'tag_refs' 10/21/2024 02:02:59.395 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:02:59.395 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource fabric: 'logical_router_back_refs' 10/21/2024 02:02:59.395 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'logical_router_back_refs' 10/21/2024 02:02:59.395 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnect_back_refs in resource fabric: 'data_center_interconnect_back_refs' 10/21/2024 02:02:59.396 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnect_back_refs' 10/21/2024 02:02:59.396 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource fabric: 'physical_router_back_refs' 10/21/2024 02:02:59.396 7fcaff0b7c18 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:02:59.633 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Object with fq_name ['target:64512:8000004'] not found in DB: Unknown id: route_target target:64512:8000004 10/21/2024 02:02:59.633 7fcaff1022e8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4752, in _post_common obj_type, obj_dict['fq_name']) File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/vnc_db.py", line 2549, in fq_name_to_uuid obj_uuid = self._object_db.fq_name_to_uuid(obj_type, fq_name) File "/usr/lib/python3.6/site-packages/cfgm_common/datastore/drivers/cassandra_cql.py", line 1031, in wrapper return func(*args, **kwargs) File "/usr/lib/python3.6/site-packages/cfgm_common/vnc_cassandra.py", line 1199, in fq_name_to_uuid raise NoIdError('%s %s' % (obj_type, fq_name_str)) vnc_api.exceptions.NoIdError: Unknown id: route_target target:64512:8000004 10/21/2024 02:02:59.634 7fcaff012630 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000004 url = https://10.0.0.30:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000004"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000004"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:59.634 7fcaff012630 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000004 url = https://10.0.0.30:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000004"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "827ef2392d544da2a91d3e2fe9d9411b", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000004"}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:59.653 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['target:64512:8000004'], 'obj_dict': {'display_name': 'target:64512:8000004', 'fq_name': ['target:64512:8000004'], 'id_perms': {'created': '2024-10-21T02:02:59.639064', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2024-10-21T02:02:59.639064', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10569696882447267828, 'uuid_mslong': 12701263231055251451}}, 'perms2': {'global_access': 0, 'owner': '827ef2392d544da2a91d3e2fe9d9411b', 'owner_access': 7, 'share': []}, 'uuid': 'b043f39d-4dc7-47fb-92af-1b505dd2b7f4'}, 'oper': 'CREATE', 'request-id': 'req-d9fe1b32-3964-4e70-a7fa-fbe5eca75dec', 'type': 'route_target', 'uuid': 'b043f39d-4dc7-47fb-92af-1b505dd2b7f4'} 10/21/2024 02:02:59.658 7fcaff0de390 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16c39030-f601-4fb0-950d-22b731678844 object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"type": "routing-instance", "uuid": "16c39030-f601-4fb0-950d-22b731678844", "ref-type": "route-target", "ref-uuid": "b043f39d-4dc7-47fb-92af-1b505dd2b7f4", "ref-fq-name": ["target:64512:8000004"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:59.658 7fcaff0de390 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 16c39030-f601-4fb0-950d-22b731678844 object_type = routing_instance identifier_name = default-domain:default-project:_internal_vn_ipv6_link_local:_internal_vn_ipv6_link_local url = https://10.0.0.30:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-juju-os-439-1:/usr/bin/contrail-schema remote_ip = 10.0.0.30 body = {"type": "routing-instance", "uuid": "16c39030-f601-4fb0-950d-22b731678844", "ref-type": "route-target", "ref-uuid": "b043f39d-4dc7-47fb-92af-1b505dd2b7f4", "ref-fq-name": ["target:64512:8000004"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 10/21/2024 02:02:59.676 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-acf66f55-fd65-408c-9bd0-0a0560c20852', 'type': 'routing_instance', 'uuid': '16c39030-f601-4fb0-950d-22b731678844'} 10/21/2024 02:02:59.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:00.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:01.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:02.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:03.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:03.804 7fcaff0b36d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:03.808 7fcaff0b36d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:03.808 7fcaff0b36d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.808 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:03.808 7fcaff0b36d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.809 7fcaff0b36d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.809 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:_internal_vn_ipv6_link_local elements = { address_allocation_mode : "user-defined-subnet-only"display_name : "_internal_vn_ipv6_link_local"fq_name : ["default-domain", "default-project", "_internal_vn_ipv6_link_local"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 9994715591917062857, "uuid_lslong": 11186655279188154269}, "enable": true, "created": "2024-10-21T02:02:59.037004", "last_modified": "2024-10-21T02:02:59.037004", "description": null, "user_visible": true, "creator": null}is_shared : falsenetwork_ipam_refs : [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": "fe80::2", "subnet_uuid": "986b4d92-8f50-11ef-8b39-76fafadcd1c7", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "43becac5-b632-455e-a111-ef0f2b387253"}]parent_type : "project"parent_uuid : "c73bc058-a0d8-418e-a889-1f0a1c75ce6f"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "8ab45ce0-6746-4ac9-9b3e-fbb4fcc2179d"virtual_network_network_id : 5 } deleted = False >> 10/21/2024 02:03:03.809 7fcaff0b36d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:03.809 7fcaff0b36d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:03.809 7fcaff0b36d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:03.809 7fcaff0b36d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.810 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:03.810 7fcaff0b36d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.810 7fcaff0b36d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:03.810 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:03.810 7fcaff0b36d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:04.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:05.337 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:03:05.337 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:03:05.338 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:03:05.338 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:03:05.339 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:03:05.339 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:03:05.339 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:03:05.340 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:03:05.340 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:03:05.340 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:03:05.340 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:03:05.341 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:03:05.341 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:03:05.341 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:03:05.342 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:03:05.342 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:03:05.342 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:03:05.343 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:03:05.343 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:03:05.343 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:03:05.344 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:03:05.344 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:03:05.344 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:03:05.345 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:03:05.345 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:03:05.346 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:03:05.346 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:03:05.346 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:03:05.346 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:03:05.347 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:03:05.347 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:03:05.347 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:03:05.348 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:03:05.348 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:03:05.348 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:03:05.349 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:03:05.349 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:03:05.349 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:03:05.349 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:03:05.350 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:03:05.350 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:03:05.350 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:03:05.350 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:03:05.351 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:03:05.351 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:03:05.351 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:03:05.352 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:03:05.352 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:03:05.352 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:03:05.353 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:03:05.353 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:03:05.353 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:03:05.354 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:03:05.354 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:03:05.354 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:03:05.355 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:03:05.355 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:03:05.356 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:03:05.356 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:03:05.356 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:03:05.356 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:03:05.357 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:03:05.357 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:03:05.357 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:03:05.358 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:03:05.358 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:03:05.358 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:03:05.358 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:03:05.455 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 10/21/2024 02:03:05.456 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_routers' 10/21/2024 02:03:05.456 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 10/21/2024 02:03:05.456 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_refs' 10/21/2024 02:03:05.456 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 10/21/2024 02:03:05.456 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_target_refs' 10/21/2024 02:03:05.456 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_aggregate_back_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_policy_back_refs' 10/21/2024 02:03:05.457 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 10/21/2024 02:03:05.458 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_back_refs' 10/21/2024 02:03:05.560 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 10/21/2024 02:03:05.560 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interfaces' 10/21/2024 02:03:05.560 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 10/21/2024 02:03:05.560 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'network_ipam_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'sub_cluster_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 10/21/2024 02:03:05.561 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:03:05.562 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 10/21/2024 02:03:05.562 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:03:05.562 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 10/21/2024 02:03:05.562 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'provider_attachment_back_refs' 10/21/2024 02:03:05.618 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 61c97f74-2765-4063-9c20-f1a4ca57c82c object_type = virtual_router identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/virtual-router/61c97f74-2765-4063-9c20-f1a4ca57c82c operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"virtual-router": {"uuid": "61c97f74-2765-4063-9c20-f1a4ca57c82c", "virtual_router_dpdk_enabled": false}} domain = default-domain project = admin user = admin >> 10/21/2024 02:03:05.631 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'oper': 'UPDATE', 'request-id': 'req-5a2750f5-3eb2-4961-862b-4c4545eb8eb7', 'type': 'virtual_router', 'uuid': '61c97f74-2765-4063-9c20-f1a4ca57c82c'} 10/21/2024 02:03:05.635 7fcaff0b7780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.635 7fcaff0b7780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7046303228851732579, "uuid_lslong": 11250257559243180076}, "enable": true, "created": "2024-10-21T02:02:50.487784", "last_modified": "2024-10-21T02:03:05.624443", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "953d4841-c203-4a7e-b905-387930676988"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "61c97f74-2765-4063-9c20-f1a4ca57c82c"virtual_router_dpdk_enabled : falsevirtual_router_ip_address : "10.0.0.30" } deleted = False >> 10/21/2024 02:03:05.635 7fcaff0b7780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:05.732 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interfaces in resource virtual-router: 'virtual_machine_interfaces' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interfaces' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field network_ipam_refs in resource virtual-router: 'network_ipam_refs' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'network_ipam_refs' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource virtual-router: 'sub_cluster_refs' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'sub_cluster_refs' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-router: 'virtual_machine_refs' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_refs' 10/21/2024 02:03:05.733 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-router: 'tag_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-router: 'instance_ip_back_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource virtual-router: 'physical_router_back_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field provider_attachment_back_refs in resource virtual-router: 'provider_attachment_back_refs' 10/21/2024 02:03:05.734 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'provider_attachment_back_refs' 10/21/2024 02:03:05.845 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_logging_object_refs in resource virtual-machine-interface: 'security_logging_object_refs' 10/21/2024 02:03:05.845 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'security_logging_object_refs' 10/21/2024 02:03:05.845 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_refs in resource virtual-machine-interface: 'qos_config_refs' 10/21/2024 02:03:05.845 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_refs' 10/21/2024 02:03:05.845 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field security_group_refs in resource virtual-machine-interface: 'security_group_refs' 10/21/2024 02:03:05.845 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'security_group_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_refs in resource virtual-machine-interface: 'virtual_machine_interface_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_refs in resource virtual-machine-interface: 'virtual_machine_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource virtual-machine-interface: 'bgp_router_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_tuple_refs in resource virtual-machine-interface: 'port_tuple_refs' 10/21/2024 02:03:05.846 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'port_tuple_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_health_check_refs in resource virtual-machine-interface: 'service_health_check_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_health_check_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field interface_route_table_refs in resource virtual-machine-interface: 'interface_route_table_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'interface_route_table_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_interface_refs in resource virtual-machine-interface: 'physical_interface_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_interface_refs' 10/21/2024 02:03:05.847 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bridge_domain_refs in resource virtual-machine-interface: 'bridge_domain_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bridge_domain_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_endpoint_refs in resource virtual-machine-interface: 'service_endpoint_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_endpoint_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_refs in resource virtual-machine-interface: 'virtual_port_group_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_port_group_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field port_profile_refs in resource virtual-machine-interface: 'port_profile_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'port_profile_refs' 10/21/2024 02:03:05.848 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource virtual-machine-interface: 'tag_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource virtual-machine-interface: 'virtual_machine_interface_back_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field instance_ip_back_refs in resource virtual-machine-interface: 'instance_ip_back_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'instance_ip_back_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field subnet_back_refs in resource virtual-machine-interface: 'subnet_back_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'subnet_back_refs' 10/21/2024 02:03:05.849 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field floating_ip_back_refs in resource virtual-machine-interface: 'floating_ip_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'floating_ip_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alias_ip_back_refs in resource virtual-machine-interface: 'alias_ip_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alias_ip_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_interface_back_refs in resource virtual-machine-interface: 'logical_interface_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'logical_interface_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource virtual-machine-interface: 'bgp_as_a_service_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_as_a_service_back_refs' 10/21/2024 02:03:05.850 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field customer_attachment_back_refs in resource virtual-machine-interface: 'customer_attachment_back_refs' 10/21/2024 02:03:05.851 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'customer_attachment_back_refs' 10/21/2024 02:03:05.851 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field logical_router_back_refs in resource virtual-machine-interface: 'logical_router_back_refs' 10/21/2024 02:03:05.851 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'logical_router_back_refs' 10/21/2024 02:03:05.851 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_pool_back_refs in resource virtual-machine-interface: 'loadbalancer_pool_back_refs' 10/21/2024 02:03:05.851 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'loadbalancer_pool_back_refs' 10/21/2024 02:03:05.851 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_ip_back_refs in resource virtual-machine-interface: 'virtual_ip_back_refs' 10/21/2024 02:03:05.852 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_ip_back_refs' 10/21/2024 02:03:05.852 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field loadbalancer_back_refs in resource virtual-machine-interface: 'loadbalancer_back_refs' 10/21/2024 02:03:05.852 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'loadbalancer_back_refs' 10/21/2024 02:03:05.852 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_port_group_back_refs in resource virtual-machine-interface: 'virtual_port_group_back_refs' 10/21/2024 02:03:05.852 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_port_group_back_refs' 10/21/2024 02:03:05.852 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field link_aggregation_group_back_refs in resource virtual-machine-interface: 'link_aggregation_group_back_refs' 10/21/2024 02:03:05.853 7fcaff0b36d8 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'link_aggregation_group_back_refs' 10/21/2024 02:03:05.908 7fcaff0b36d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 62338fc6-1c29-4a80-9c2c-c12c5608156e object_type = virtual_machine_interface identifier_name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 url = https://10.0.0.30:8082/virtual-machine-interface/62338fc6-1c29-4a80-9c2c-c12c5608156e operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.30 body = {"virtual-machine-interface": {"uuid": "62338fc6-1c29-4a80-9c2c-c12c5608156e", "virtual_machine_interface_disable_policy": true}} domain = default-domain project = admin user = admin >> 10/21/2024 02:03:05.927 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-439-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-a5e1084f-c198-4f42-95bd-f51b5b9cbf9e', 'type': 'virtual_machine_interface', 'uuid': '62338fc6-1c29-4a80-9c2c-c12c5608156e'} 10/21/2024 02:03:05.932 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:05.932 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-global-system-config:cn-jenkins-deploy-platform-juju-os-439-1:vhost0 elements = { display_name : "vhost0"fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-juju-os-439-1", "vhost0"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7076157520567945856, "uuid_lslong": 11253581965058119022}, "enable": true, "created": "2024-10-21T02:02:50.913670", "last_modified": "2024-10-21T02:03:05.919346", "description": null, "user_visible": true, "creator": null}parent_type : "virtual-router"parent_uuid : "61c97f74-2765-4063-9c20-f1a4ca57c82c"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}routing_instance_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "ip-fabric"], "attr": {"direction": "both", "vlan_tag": null, "src_mac": null, "dst_mac": null, "mpls_label": null, "service_chain_address": null, "ipv6_service_chain_address": null, "protocol": null}, "uuid": "04b5002c-41a0-4bf2-a878-358fac405bef"}]uuid : "62338fc6-1c29-4a80-9c2c-c12c5608156e"virtual_machine_interface_disable_policy : truevirtual_machine_interface_mac_addresses : {"mac_address": ["02:62:33:8f:c6:1c"]}virtual_network_refs : [{"to": ["default-domain", "default-project", "ip-fabric"], "attr": null, "uuid": "1e338ece-fda8-4842-aa92-7ce58d0af31f"}] } deleted = False >> 10/21/2024 02:03:05.932 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:06.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:07.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:07.804 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:08.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:09.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:10.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:11.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:12.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:12.807 7fcafef2a630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:12.808 7fcafef2a630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:12.808 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:12.808 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:12.808 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:12.808 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:12.809 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:13.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:14.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:15.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:16.808 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:17.697 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:18.699 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:19.700 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:20.702 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:21.704 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:21.792 7fcafec76a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:03:21.810 7fcafef2a630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:21.810 7fcafef2a630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:21.810 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:21.810 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:21.811 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:21.811 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:21.811 7fcafef2a630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:21.812 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.812 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:21.812 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.812 7fcafef2a630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.812 7fcafef2a630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:21.812 7fcafef2a630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:21.845 7fcafec76a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:03:22.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:23.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:24.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:25.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:25.810 7fcafee26780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:26.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:27.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:28.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:29.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:30.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:30.813 7fcafee26780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:30.813 7fcafee26780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:30.813 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:30.813 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:30.813 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:30.813 7fcafee26780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:30.814 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:31.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:32.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:33.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:34.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:34.813 7fcafee26780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:35.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:35.937 7fcaff028c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:03:35.990 7fcaff028c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:03:36.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:37.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:38.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:39.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:39.814 7fcafee26780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:39.815 7fcafee26780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:39.815 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:39.815 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:39.815 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:39.815 7fcafee26780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:39.816 7fcafee26780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:39.816 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.816 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:39.816 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.816 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:39.816 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:39.817 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:40.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:41.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:42.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:43.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:43.815 7fcafee26780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:44.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:45.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:47.697 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:48.699 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:48.817 7fcafee26780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:48.817 7fcafee26780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:48.817 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:48.817 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:48.818 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:48.818 7fcafee26780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:48.818 7fcafee26780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:48.818 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.818 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:48.818 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.819 7fcafee26780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:48.819 7fcafee26780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:48.819 7fcafee26780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:49.701 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:50.703 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:51.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:52.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:52.818 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:03:53.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:54.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:55.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:56.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:57.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:57.821 7fcaff0b6588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:03:57.821 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:03:57.821 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:57.821 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:03:57.821 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:03:57.821 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:03:57.822 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:03:57.822 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:57.822 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:03:57.822 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:57.822 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:57.822 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:03:57.823 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:03:58.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:03:59.720 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:00.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:01.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:01.821 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:02.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:03.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:04.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:05.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:06.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:06.823 7fcaff0b6588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:06.824 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:06.824 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:06.824 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:06.824 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:06.824 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:04:06.825 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:07.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:08.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:09.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:10.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:10.824 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:11.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:12.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:13.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:14.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:15.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:15.826 7fcaff0b6588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:15.826 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:15.826 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:15.826 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:15.827 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:15.827 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:15.827 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:15.827 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.828 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:15.828 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.828 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:15.828 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:04:15.828 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:17.699 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:18.701 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:19.702 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:19.827 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:20.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:21.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:22.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:23.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:24.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:24.828 7fcaff0b6588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:24.829 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:24.829 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:24.830 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:24.830 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:24.830 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:04:24.831 7fcaff0b6588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:25.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:26.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:27.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:28.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:28.829 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:29.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:30.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:31.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:32.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:33.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:33.831 7fcafedbe4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:33.831 7fcafedbe4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:33.831 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:33.832 7fcafedbe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:33.832 7fcafedbe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:33.832 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:33.832 7fcafedbe4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:33.833 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.834 7fcafedbe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:33.834 7fcafedbe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.834 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:33.834 7fcafedbe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:04:33.834 7fcafedbe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:34.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:35.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:36.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:37.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:37.831 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:38.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:39.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:40.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:41.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:42.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:42.834 7fcafedbe4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:42.835 7fcafedbe4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:42.835 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:42.835 7fcafedbe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:42.835 7fcafedbe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:42.835 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:04:42.836 7fcafedbe4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:43.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:44.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:45.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:46.835 7fcafee0f0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:47.699 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:48.701 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:49.703 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:50.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:51.706 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:51.837 7fcafee0f0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:04:51.837 7fcafee0f0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:04:51.837 7fcafee0f0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:51.838 7fcafee0f0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:04:51.838 7fcafee0f0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:04:51.838 7fcafee0f0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:04:51.839 7fcafee0f0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:04:51.839 7fcafee0f0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:51.839 7fcafee0f0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:04:51.839 7fcafee0f0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:51.839 7fcafee0f0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:51.839 7fcafee0f0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:04:51.840 7fcafee0f0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:04:52.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:53.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:54.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:54.953 7fcafef5d8d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:04:55.005 7fcafef5d8d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:04:55.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:55.837 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:04:56.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:57.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:58.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:04:59.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:00.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:00.839 7fcafef5d8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:00.840 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:00.840 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:00.840 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:00.841 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:00.841 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:00.841 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:00.842 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.842 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:00.842 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.842 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:00.842 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:00.842 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:01.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:02.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:03.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:04.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:04.840 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:05.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:06.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:07.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:08.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:09.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:09.843 7fcafef5d8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:09.843 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:09.843 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:09.843 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:09.843 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:09.843 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:09.844 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:09.844 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.844 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:09.844 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.844 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:09.845 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:09.845 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:10.215 7fcafef5d8d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:05:10.267 7fcafef5d8d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:05:10.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:11.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:12.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:13.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:13.844 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:14.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:15.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:17.701 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:18.703 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:18.846 7fcafef5d8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:18.846 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:18.846 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:18.846 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:18.846 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:18.847 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:18.847 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:18.847 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.847 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:18.848 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.848 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:18.848 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:18.848 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:19.705 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:20.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:21.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:22.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:22.847 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:23.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:24.302 7fcaff0d3c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:05:24.352 7fcafee3f198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:05:24.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:25.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:26.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:27.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:27.848 7fcafef5d8d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:27.848 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:27.848 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:27.849 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:27.849 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:27.849 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:27.849 7fcafef5d8d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:27.849 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.850 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:27.850 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.850 7fcafef5d8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:27.850 7fcafef5d8d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:27.850 7fcafef5d8d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:28.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:29.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:30.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:31.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:31.849 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:32.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:33.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:34.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:35.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:36.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:36.851 7fcafeeaa828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:36.851 7fcafeeaa828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:36.852 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:36.852 7fcafeeaa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:36.852 7fcafeeaa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:36.852 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:36.852 7fcafeeaa828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:36.853 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.853 7fcafeeaa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:36.853 7fcafeeaa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.853 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:36.853 7fcafeeaa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:36.853 7fcafeeaa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:37.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:38.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:39.574 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Parent key not found for resource global-system-config: 'parent_type' 10/21/2024 02:05:39.574 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4280, in generate_hrefs obj_dict['parent_type'], obj_dict['parent_uuid']) KeyError: 'parent_type' 10/21/2024 02:05:39.574 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field feature_flags in resource global-system-config: 'feature_flags' 10/21/2024 02:05:39.574 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'feature_flags' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zones in resource global-system-config: 'control_node_zones' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zones' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_vrouter_configs in resource global-system-config: 'global_vrouter_configs' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_vrouter_configs' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_qos_configs in resource global-system-config: 'global_qos_configs' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_qos_configs' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_routers in resource global-system-config: 'virtual_routers' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_routers' 10/21/2024 02:05:39.575 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_nodes in resource global-system-config: 'config_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_nodes in resource global-system-config: 'analytics_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field flow_nodes in resource global-system-config: 'flow_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'flow_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field devicemgr_nodes in resource global-system-config: 'devicemgr_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'devicemgr_nodes' 10/21/2024 02:05:39.576 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field database_nodes in resource global-system-config: 'database_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'database_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field webui_nodes in resource global-system-config: 'webui_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'webui_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_database_nodes in resource global-system-config: 'config_database_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_database_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_alarm_nodes in resource global-system-config: 'analytics_alarm_nodes' 10/21/2024 02:05:39.577 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_alarm_nodes' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field analytics_snmp_nodes in resource global-system-config: 'analytics_snmp_nodes' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'analytics_snmp_nodes' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field service_appliance_sets in resource global-system-config: 'service_appliance_sets' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'service_appliance_sets' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field api_access_lists in resource global-system-config: 'api_access_lists' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'api_access_lists' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field alarms in resource global-system-config: 'alarms' 10/21/2024 02:05:39.578 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'alarms' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field config_propertiess in resource global-system-config: 'config_propertiess' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'config_propertiess' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field job_templates in resource global-system-config: 'job_templates' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'job_templates' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field data_center_interconnects in resource global-system-config: 'data_center_interconnects' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'data_center_interconnects' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field intent_maps in resource global-system-config: 'intent_maps' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'intent_maps' 10/21/2024 02:05:39.579 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field fabrics in resource global-system-config: 'fabrics' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'fabrics' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field node_profiles in resource global-system-config: 'node_profiles' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'node_profiles' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_routers in resource global-system-config: 'physical_routers' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_routers' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field device_images in resource global-system-config: 'device_images' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'device_images' 10/21/2024 02:05:39.580 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field nodes in resource global-system-config: 'nodes' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'nodes' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field features in resource global-system-config: 'features' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'features' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_roles in resource global-system-config: 'physical_roles' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_roles' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field overlay_roles in resource global-system-config: 'overlay_roles' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'overlay_roles' 10/21/2024 02:05:39.581 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field role_definitions in resource global-system-config: 'role_definitions' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'role_definitions' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field global_analytics_configs in resource global-system-config: 'global_analytics_configs' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'global_analytics_configs' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource global-system-config: 'tag_refs' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field qos_config_back_refs in resource global-system-config: 'qos_config_back_refs' 10/21/2024 02:05:39.582 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'qos_config_back_refs' 10/21/2024 02:05:39.689 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource config-node: 'tag_refs' 10/21/2024 02:05:39.690 7fcafeeaa828 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:05:39.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:40.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:40.851 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:41.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:42.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:43.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:44.744 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:45.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:45.854 7fcafeeaa828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:45.854 7fcafeeaa828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:45.854 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:45.855 7fcafeeaa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:45.855 7fcafeeaa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:45.855 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:45.855 7fcafeeaa828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:45.855 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.856 7fcafeeaa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:45.856 7fcafeeaa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.856 7fcafeeaa828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:45.856 7fcafeeaa828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:45.856 7fcafeeaa828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:47.702 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:48.703 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:49.704 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:49.855 7fcafede88d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:50.706 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:51.491 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_routers in resource routing-instance: 'bgp_routers' 10/21/2024 02:05:51.491 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_routers' 10/21/2024 02:05:51.491 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_refs in resource routing-instance: 'routing_instance_refs' 10/21/2024 02:05:51.491 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_refs' 10/21/2024 02:05:51.491 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_target_refs in resource routing-instance: 'route_target_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_target_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource routing-instance: 'tag_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource routing-instance: 'virtual_machine_interface_back_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field route_aggregate_back_refs in resource routing-instance: 'route_aggregate_back_refs' 10/21/2024 02:05:51.492 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'route_aggregate_back_refs' 10/21/2024 02:05:51.493 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_policy_back_refs in resource routing-instance: 'routing_policy_back_refs' 10/21/2024 02:05:51.493 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_policy_back_refs' 10/21/2024 02:05:51.493 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field routing_instance_back_refs in resource routing-instance: 'routing_instance_back_refs' 10/21/2024 02:05:51.493 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'routing_instance_back_refs' 10/21/2024 02:05:51.654 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field control_node_zone_refs in resource bgp-router: 'control_node_zone_refs' 10/21/2024 02:05:51.654 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'control_node_zone_refs' 10/21/2024 02:05:51.654 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field sub_cluster_refs in resource bgp-router: 'sub_cluster_refs' 10/21/2024 02:05:51.654 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'sub_cluster_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_refs in resource bgp-router: 'bgp_router_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field tag_refs in resource bgp-router: 'tag_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'tag_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field physical_router_back_refs in resource bgp-router: 'physical_router_back_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'physical_router_back_refs' 10/21/2024 02:05:51.655 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field virtual_machine_interface_back_refs in resource bgp-router: 'virtual_machine_interface_back_refs' 10/21/2024 02:05:51.656 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'virtual_machine_interface_back_refs' 10/21/2024 02:05:51.656 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_as_a_service_back_refs in resource bgp-router: 'bgp_as_a_service_back_refs' 10/21/2024 02:05:51.656 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_as_a_service_back_refs' 10/21/2024 02:05:51.656 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Key not found for field bgp_router_back_refs in resource bgp-router: 'bgp_router_back_refs' 10/21/2024 02:05:51.656 7fcafee5ca20 [contrail-api] [WARNING]: __default__ [SYS_WARN]: VncApiDebug: Traceback: Traceback (most recent call last): File "/usr/lib/python3.6/site-packages/vnc_cfg_api_server/api_server.py", line 4295, in generate_hrefs for link in obj_dict[field]: KeyError: 'bgp_router_back_refs' 10/21/2024 02:05:51.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:51.709 7fcafed50b70 [contrail-api] [ERROR]: SANDESH: Not connected: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6595929d-71c1-408c-9fc5-f5862213e5f7 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/bgp-router/6595929d-71c1-408c-9fc5-f5862213e5f7 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"bgp-router": {"uuid": "6595929d-71c1-408c-9fc5-f5862213e5f7", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.30", "address": "10.0.0.30", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:05:51.710 7fcafed50b70 [contrail-api] [ERROR]: SANDESH: [DROP: SessionNotConnected] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6595929d-71c1-408c-9fc5-f5862213e5f7 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-juju-os-439-1 url = https://10.0.0.30:8082/bgp-router/6595929d-71c1-408c-9fc5-f5862213e5f7 operation = http_put useragent = cn-jenkins-deploy-platform-juju-os-439-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.30 body = {"bgp-router": {"uuid": "6595929d-71c1-408c-9fc5-f5862213e5f7", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.30", "address": "10.0.0.30", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}}} domain = default-domain project = admin user = admin >> 10/21/2024 02:05:51.725 7fcaff777588 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-439-1'], 'oper': 'UPDATE', 'request-id': 'req-4b3ea080-434c-4c03-931f-6554d756dcea', 'type': 'bgp_router', 'uuid': '6595929d-71c1-408c-9fc5-f5862213e5f7'} 10/21/2024 02:05:52.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:53.203 7fcafee5ca20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:05:53.253 7fcafee5ca20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:05:53.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:54.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:54.857 7fcafede88d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:05:54.858 7fcafede88d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:05:54.858 7fcafede88d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:54.858 7fcafede88d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:05:54.858 7fcafede88d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:54.858 7fcafede88d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:54.858 7fcafede88d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.0.0.30", "address": "10.0.0.30", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-juju-os-439-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-juju-os-439-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "reader", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7319917974276620428, "uuid_lslong": 11512877978888693239}, "enable": true, "created": "2024-10-21T02:01:51.607506", "last_modified": "2024-10-21T02:05:51.719458", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "23d94074-d92d-4962-a86d-ec011c6e2f3c"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6595929d-71c1-408c-9fc5-f5862213e5f7" } deleted = False >> 10/21/2024 02:05:54.859 7fcafede88d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:05:54.859 7fcafede88d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:05:54.859 7fcafede88d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:05:54.859 7fcafede88d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.859 7fcafede88d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:05:54.859 7fcafede88d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.860 7fcafede88d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:54.860 7fcafede88d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:05:54.860 7fcafede88d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:05:55.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:56.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:57.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:58.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:05:58.859 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:05:59.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:00.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:01.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:02.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:03.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:03.861 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:03.861 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:03.861 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:03.861 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:03.861 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:03.861 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:03.862 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:03.862 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.862 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:03.862 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.862 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:03.862 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:03.863 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:04.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:05.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:06.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:07.750 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:07.864 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:08.754 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:09.755 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:10.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:11.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:12.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:12.866 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:12.866 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:12.867 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:12.867 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:12.867 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:12.867 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:12.868 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:13.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:14.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:15.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:16.867 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:17.702 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:18.704 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:19.706 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:20.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:21.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:21.870 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:21.870 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:21.870 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:21.870 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:21.870 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:21.870 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:21.871 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:21.871 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.871 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:21.871 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.871 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:21.872 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:21.872 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:22.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:23.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:24.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:25.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:25.870 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:26.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:27.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:28.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:29.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:30.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:30.872 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:30.873 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:30.873 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:30.873 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:30.873 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:30.873 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:30.874 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:31.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:32.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:33.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:34.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:34.873 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:35.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:36.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:37.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:38.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:39.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:39.876 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:39.876 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:39.876 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:39.876 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:39.876 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:39.877 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:39.877 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:39.877 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.877 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:39.877 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.877 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:39.878 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:39.878 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:40.744 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:41.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:42.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:43.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:43.876 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:44.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:45.752 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:47.706 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:48.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:48.878 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:48.879 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:48.879 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:48.879 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:48.879 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:48.879 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:48.880 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:49.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:50.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:51.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:52.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:52.879 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:06:53.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:54.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:55.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:56.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:57.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:57.881 7fcaff0f6978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:06:57.881 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:06:57.881 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:57.881 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:06:57.881 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:06:57.882 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:06:57.882 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:06:57.882 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:57.882 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:06:57.882 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:57.882 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:57.883 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:06:57.883 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:06:58.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:06:59.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:00.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:01.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:01.881 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:02.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:03.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:04.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:05.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:06.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:06.883 7fcaff0f6978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:06.884 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:06.884 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:06.884 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:06.884 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:06.884 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:07:06.885 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:07.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:08.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:09.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:10.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:10.884 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:11.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:12.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:13.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:14.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:15.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:15.886 7fcaff0f6978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:15.886 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:15.886 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:15.887 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:15.887 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:15.887 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:15.887 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:15.887 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.888 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:15.888 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.888 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:15.888 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:07:15.888 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:17.707 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:18.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:19.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:19.887 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:20.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:21.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:22.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:23.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:24.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:24.889 7fcaff0f6978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:24.889 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:24.890 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:24.890 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:24.891 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:24.891 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:24.892 7fcaff0f6978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:24.892 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.893 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:24.893 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.893 7fcaff0f6978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:24.893 7fcaff0f6978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:07:24.893 7fcaff0f6978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:25.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:26.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:27.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:28.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:28.889 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:29.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:30.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:31.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:32.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:33.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:33.891 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:33.891 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:33.891 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:33.892 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:33.892 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:33.892 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:33.892 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:33.892 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.893 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:33.893 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.893 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:33.893 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:07:33.893 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:34.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:35.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:36.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:37.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:37.891 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:38.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:39.744 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:40.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:41.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:42.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:42.894 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:42.894 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:42.894 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:42.895 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:42.895 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:42.895 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:42.895 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:42.895 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.896 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:42.896 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.896 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:42.896 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:07:42.896 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:43.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:44.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:45.754 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:46.894 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:47.708 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:48.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:49.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:50.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:51.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:51.897 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:07:51.897 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:07:51.897 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:51.898 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:07:51.898 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:07:51.898 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:07:51.899 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:07:51.899 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.899 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:07:51.899 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.899 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:51.900 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:07:51.900 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:07:52.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:53.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:54.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:55.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:55.897 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:07:56.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:57.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:58.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:07:59.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:00.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:00.900 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:00.901 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:00.902 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:00.902 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:00.902 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:00.902 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:00.903 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:01.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:02.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:03.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:04.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:04.901 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:05.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:06.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:07.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:08.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:09.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:09.903 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:09.904 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:09.904 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:09.904 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:09.904 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:09.904 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:09.904 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:09.905 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.905 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:09.905 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.905 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:09.905 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:09.905 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:10.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:11.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:12.752 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:13.752 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:13.904 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:14.754 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:15.755 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:17.709 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:18.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:18.906 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:18.906 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:18.907 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:18.907 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:18.907 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:18.907 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:18.907 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:18.907 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.908 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:18.908 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.908 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:18.908 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:18.908 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:19.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:20.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:21.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:22.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:22.907 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:23.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:24.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:25.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:26.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:27.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:27.909 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:27.910 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:27.910 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:27.910 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:27.910 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:27.910 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:27.911 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:28.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:29.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:30.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:31.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:31.910 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:32.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:33.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:34.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:35.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:36.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:36.912 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:36.913 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:36.913 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:36.913 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:36.913 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:36.913 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:36.913 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:36.914 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.914 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:36.914 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.914 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:36.914 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:36.914 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:37.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:38.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:39.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:40.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:40.913 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:41.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:42.750 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:43.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:44.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:45.755 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:45.915 7fcaff00b390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:45.916 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:45.916 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:45.916 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:45.916 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:45.916 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:45.917 7fcaff00b390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:47.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:48.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:49.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:49.916 7fcafebfe438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:50.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:51.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:52.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:53.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:54.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:54.918 7fcafebfe438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:08:54.918 7fcafebfe438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:08:54.918 7fcafebfe438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:54.918 7fcafebfe438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:08:54.918 7fcafebfe438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:08:54.918 7fcafebfe438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:08:54.919 7fcafebfe438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:08:54.919 7fcafebfe438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.919 7fcafebfe438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:08:54.919 7fcafebfe438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.920 7fcafebfe438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:54.920 7fcafebfe438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:08:54.920 7fcafebfe438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:08:55.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:56.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:57.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:58.323 7fcafef1e978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:08:58.377 7fcafec012e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:08:58.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:08:58.918 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:08:59.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:00.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:01.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:02.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:03.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:03.919 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:03.920 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:03.920 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:03.920 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:03.920 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:03.920 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:03.921 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:04.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:05.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:06.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:07.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:07.920 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:08.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:09.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:10.750 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:11.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:12.217 7fcafef620f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:09:12.273 7fcafef620f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:09:12.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:12.922 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:12.922 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:12.923 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:12.923 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:12.923 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:12.923 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:12.923 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:12.924 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.924 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:12.924 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.924 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:12.924 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:12.924 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:13.754 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:14.756 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:15.758 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:16.923 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:17.710 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:18.711 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:19.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:20.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:21.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:21.925 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:21.927 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:21.927 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:21.927 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:21.927 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:21.927 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:21.928 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:22.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:23.720 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:24.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:25.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:25.925 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:26.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:27.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:28.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:29.218 7fcafebf00f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:09:29.269 7fcafebf00f0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:09:29.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:30.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:30.928 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:30.929 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:30.929 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:30.929 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:30.929 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:30.929 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:30.930 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:30.930 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.931 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:30.931 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.931 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:30.931 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:30.931 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:31.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:32.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:33.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:34.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:34.929 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:35.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:36.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:37.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:38.744 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:39.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:39.931 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:39.932 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:39.932 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:39.932 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:39.932 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:39.932 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:39.933 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:40.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:41.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:42.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:43.752 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:43.932 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:44.754 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:45.756 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:47.712 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:48.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:48.933 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:48.934 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:48.934 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:48.934 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:48.934 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:48.934 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:48.935 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:49.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:50.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:51.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:52.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:52.934 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:09:53.723 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:54.041 7fcaff0b3f60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:09:54.097 7fcaff0b3f60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:09:54.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:55.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:56.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:57.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:57.936 7fcafebf98d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:09:57.936 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:09:57.936 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:09:57.937 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.938 7fcafebf98d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:57.938 7fcafebf98d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:09:57.938 7fcafebf98d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:09:58.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:09:59.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:00.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:01.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:01.936 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:02.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:03.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:04.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:05.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:06.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:06.939 7fcafef62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:06.939 7fcafef62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:06.939 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:06.939 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:06.939 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:06.939 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:06.940 7fcafef62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:06.940 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.940 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:06.941 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.941 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:06.941 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:10:06.941 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:07.744 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:08.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:09.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:10.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:10.939 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:11.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:12.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:13.755 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:14.758 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:15.760 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:15.942 7fcafef62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:15.942 7fcafef62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:15.942 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:15.943 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:15.943 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:15.943 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:15.943 7fcafef62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:15.943 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.944 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:15.944 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.944 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:15.944 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:10:15.944 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:17.713 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:18.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:19.716 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:19.942 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:20.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:21.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:22.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:23.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:24.725 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:24.944 7fcafef62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:24.945 7fcafef62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:24.945 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:24.945 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:24.945 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:24.945 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:24.946 7fcafef62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:24.946 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.946 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:24.946 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.947 7fcafef62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:24.947 7fcafef62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:10:24.947 7fcafef62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:25.727 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:26.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:27.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:28.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:28.945 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:29.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:30.736 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:31.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:32.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:33.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:33.947 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:33.948 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:33.948 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:33.948 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:33.948 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:33.948 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:10:33.949 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:34.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:35.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:36.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:37.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:37.948 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:38.750 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:39.752 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:40.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:41.756 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:42.757 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:42.951 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:42.951 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:42.951 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:42.951 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:42.951 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:42.951 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:42.952 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:42.952 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.952 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:42.952 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.952 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:42.953 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:10:42.953 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:43.759 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:44.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:45.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:46.951 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:47.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:48.714 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:49.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:50.719 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:51.721 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:51.954 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:10:51.954 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:10:51.954 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:51.955 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:10:51.955 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:10:51.955 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:10:51.956 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:10:51.956 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.956 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:10:51.956 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.956 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:51.956 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:10:51.957 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:10:52.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:53.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:54.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:55.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:55.954 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:10:56.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:57.730 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:58.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:10:59.733 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:00.735 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:00.956 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:00.957 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:00.957 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:00.957 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:00.957 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:00.958 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:00.958 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:00.958 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.959 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:00.959 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.960 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:00.960 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:00.960 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:01.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:02.739 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:03.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:04.742 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:04.957 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:05.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:06.745 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:07.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:08.748 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:09.750 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:09.959 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:09.960 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:09.960 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:09.960 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:09.960 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:09.960 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:09.961 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:10.752 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:11.754 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:12.755 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:13.757 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:13.960 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:14.759 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:15.760 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:17.715 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:18.717 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:18.962 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:18.963 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:18.963 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:18.963 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:18.963 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:18.964 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:18.964 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:18.964 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.965 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:18.965 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.965 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:18.965 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:18.965 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:19.718 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:20.720 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:21.722 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:22.724 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:22.963 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:23.726 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:24.728 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:25.729 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:26.731 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:27.732 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:27.965 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:27.966 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:27.966 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:27.966 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:27.966 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:27.966 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:27.967 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:28.734 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:29.737 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:30.738 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:31.740 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:31.965 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:32.741 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:33.743 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:34.744 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:35.746 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:36.747 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:36.968 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:36.968 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:36.968 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:36.968 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:36.968 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:36.968 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:36.969 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:36.969 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.969 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:36.969 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.969 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:36.970 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:36.970 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:37.749 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:38.751 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:39.753 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:40.757 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:40.969 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:41.759 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:42.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:43.762 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:44.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:45.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:45.973 7fcafebf1eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:45.973 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:45.973 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:45.974 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:45.974 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:45.974 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:45.974 7fcafebf1eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:45.974 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.974 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:45.975 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.975 7fcafebf1eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:45.975 7fcafebf1eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:45.975 7fcafebf1eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:47.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:48.765 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:49.767 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:49.973 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:50.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:51.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:52.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:53.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:54.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:54.976 7fcafec8a390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:11:54.976 7fcafec8a390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:11:54.976 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:54.977 7fcafec8a390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:11:54.977 7fcafec8a390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:11:54.977 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:11:54.977 7fcafec8a390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:11:54.979 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.979 7fcafec8a390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:11:54.979 7fcafec8a390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.980 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:54.980 7fcafec8a390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:11:54.980 7fcafec8a390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:11:55.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:56.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:57.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:58.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:11:58.977 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:11:59.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:00.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:01.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:02.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:03.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:03.979 7fcafec8a390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:03.979 7fcafec8a390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:03.979 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:03.979 7fcafec8a390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:03.980 7fcafec8a390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:03.980 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:03.980 7fcafec8a390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:03.980 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:03.980 7fcafec8a390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:03.981 7fcafec8a390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:03.981 7fcafec8a390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:03.981 7fcafec8a390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:03.981 7fcafec8a390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:04.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:05.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:06.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:07.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:07.979 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:08.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:09.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:10.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:11.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:12.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:12.982 7fcafefe1c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:12.982 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:12.982 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:12.982 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:12.983 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:12.983 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:12.983 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:12.983 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.983 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:12.983 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.984 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:12.984 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:12.984 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:13.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:14.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:15.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:16.983 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:17.758 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:18.760 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:19.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:20.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:21.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:21.985 7fcafefe1c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:21.985 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:21.985 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:21.985 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:21.985 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:21.985 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:21.986 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:22.765 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:23.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:24.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:25.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:25.986 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:26.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:27.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:28.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:29.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:30.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:30.987 7fcafefe1c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:30.987 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:30.988 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:30.988 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:30.988 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:30.988 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:30.988 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:30.988 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.989 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:30.989 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.989 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:30.989 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:30.989 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:31.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:32.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:33.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:34.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:34.988 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:35.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:36.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:37.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:38.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:39.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:39.990 7fcafefe1c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:39.990 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:39.990 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:39.991 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:39.991 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:39.991 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:39.992 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:39.992 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:39.992 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:39.992 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:39.992 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:39.992 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:39.993 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:40.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:41.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:42.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:43.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:43.990 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:44.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:45.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:47.757 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:48.758 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:48.993 7fcafefe1c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:48.993 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:48.993 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:48.993 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:48.993 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:48.993 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:48.994 7fcafefe1c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:49.759 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:50.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:51.762 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:52.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:52.994 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:12:53.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:54.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:55.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:56.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:57.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:57.996 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:12:57.997 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:12:57.997 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:57.997 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:12:57.997 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:12:57.997 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:12:57.998 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:12:58.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:12:59.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:00.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:01.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:01.997 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:02.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:03.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:04.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:05.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:06.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:06.999 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:07.000 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:07.000 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:07.000 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:07.000 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:07.000 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:13:07.001 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:07.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:08.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:09.219 7fcafedeac18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:13:09.268 7fcafedeac18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:13:09.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:10.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:11.001 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:11.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:12.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:13.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:14.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:15.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:16.003 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:16.003 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:16.003 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:16.003 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:16.004 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:16.004 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:16.004 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:16.005 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.005 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:16.005 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.005 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:16.005 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:13:16.006 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:17.758 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:18.759 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:19.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:20.004 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:20.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:21.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:22.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:23.045 7fcafecad438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:13:23.099 7fcafecad438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:13:23.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:24.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:25.006 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:25.007 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:25.007 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:25.007 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:25.007 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:25.007 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:13:25.008 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:25.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:26.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:27.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:28.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:29.007 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:29.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:30.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:31.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:32.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:33.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:34.009 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:34.009 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:34.009 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:34.009 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:34.009 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:34.009 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:34.010 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:34.010 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.010 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:34.010 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.010 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.011 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:13:34.011 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:34.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:35.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:36.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:37.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:38.009 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:38.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:39.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:40.194 7fcafec7dd68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:13:40.249 7fcaff000d68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:13:40.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:41.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:42.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:43.011 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:43.011 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:43.011 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:43.012 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:43.012 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:43.012 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:43.012 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:43.012 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.012 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:43.013 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.013 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.013 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:13:43.013 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:43.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:44.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:45.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:47.012 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:47.758 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:48.759 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:49.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:50.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:51.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:52.014 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:13:52.014 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:13:52.014 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:52.015 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:13:52.015 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:13:52.015 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:13:52.016 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:13:52.016 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.016 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:13:52.016 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.016 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.017 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:13:52.017 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:13:52.767 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:53.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:54.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:55.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:56.014 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:13:56.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:57.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:58.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:13:59.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:00.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:01.016 7fcafedeac18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:01.017 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:01.017 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:01.017 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:01.017 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:01.017 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:01.018 7fcafedeac18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:01.018 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.019 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:01.019 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.019 7fcafedeac18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.019 7fcafedeac18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:01.019 7fcafedeac18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:01.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:02.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:03.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:04.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:05.017 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:05.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:06.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:07.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:08.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:09.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:10.020 7fcafec62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:10.020 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:10.020 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:10.020 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:10.021 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:10.021 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:10.021 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:10.021 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.022 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:10.022 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.022 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.022 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:10.022 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:10.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:11.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:12.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:13.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:14.020 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:14.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:15.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:17.760 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:18.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:19.022 7fcafec62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:19.022 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:19.022 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:19.023 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:19.023 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:19.023 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:19.023 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:19.023 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.024 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:19.024 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.024 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.024 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:19.024 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:19.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:20.765 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:21.767 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:22.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:23.023 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:23.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:24.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:25.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:26.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:27.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:28.025 7fcafec62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:28.025 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:28.025 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:28.025 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:28.025 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:28.026 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:28.026 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:28.026 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.026 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:28.026 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.026 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.027 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:28.027 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:28.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:29.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:30.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:31.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:32.026 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:32.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:33.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:34.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:35.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:36.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:37.029 7fcafec62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:37.029 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:37.029 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:37.030 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:37.030 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:37.030 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:37.030 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:37.031 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.031 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:37.031 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.031 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.031 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:37.031 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:37.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:38.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:39.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:40.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:41.030 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:41.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:42.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:43.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:44.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:45.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:46.032 7fcafec62f60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:46.032 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:46.032 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:46.032 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:46.032 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:46.032 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:46.033 7fcafec62f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:47.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:48.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:49.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:50.032 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:50.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:51.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:52.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:53.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:54.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:55.034 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:14:55.035 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:14:55.035 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:55.035 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:14:55.035 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:14:55.035 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:14:55.035 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:14:55.036 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.036 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:14:55.036 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.036 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.036 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:14:55.036 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:14:55.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:56.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:57.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:58.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:14:59.035 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:14:59.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:00.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:01.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:02.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:03.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:04.037 7fcaff0004e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:04.037 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:04.038 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:04.038 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:04.038 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:04.038 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:04.039 7fcaff0004e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:04.039 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.039 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:04.039 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.039 7fcaff0004e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.040 7fcaff0004e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:04.040 7fcaff0004e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:04.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:05.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:06.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:07.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:08.038 7fcafec08240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:08.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:09.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:10.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:11.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:12.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:13.040 7fcafec08240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:13.040 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:13.040 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:13.040 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:13.040 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:13.040 7fcafec08240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:13.041 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:13.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:14.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:15.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:17.040 7fcafec08240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:17.761 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:18.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:19.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:20.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:21.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:22.042 7fcafec08240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:22.042 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:22.043 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:22.043 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:22.043 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:22.043 7fcafec08240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:22.044 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:22.044 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.044 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:22.044 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.044 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.045 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:22.045 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:22.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:23.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:24.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:25.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:26.042 7fcafec08240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:26.176 7fcafec090f0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:15:26.234 7fcafec6a390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:15:26.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:27.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:28.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:29.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:30.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:31.045 7fcafec08240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:31.045 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:31.045 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:31.045 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:31.045 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:31.046 7fcafec08240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:31.046 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:31.046 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.046 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:31.046 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.046 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.047 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:31.047 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:31.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:32.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:33.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:34.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:35.045 7fcafec08240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:35.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:36.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:37.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:38.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:39.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:40.047 7fcafec08240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:40.047 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:40.047 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:40.048 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:40.048 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:40.048 7fcafec08240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:40.048 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:40.048 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.049 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:40.049 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.049 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.049 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:40.049 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:40.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:41.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:42.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:43.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:44.048 7fcafec08240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:44.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:45.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:47.763 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:48.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:49.050 7fcafec08240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:49.051 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:49.051 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:49.051 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:49.051 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:49.051 7fcafec08240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:49.052 7fcafec08240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:49.052 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.052 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:49.052 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.053 7fcafec08240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.053 7fcafec08240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:49.053 7fcafec08240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:49.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:50.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:51.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:52.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:53.051 7fcafec17048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:15:53.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:54.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:55.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:56.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:57.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:58.053 7fcafec17048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:15:58.054 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:15:58.054 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:58.054 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:15:58.054 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:15:58.054 7fcafec17048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:15:58.055 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:15:58.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:15:59.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:00.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:01.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:02.054 7fcafec17048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:02.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:03.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:04.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:05.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:06.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:07.056 7fcafec17048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:07.056 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:07.057 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:07.057 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:07.057 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:07.057 7fcafec17048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:07.058 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:07.058 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.058 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:07.058 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.058 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.059 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:16:07.059 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:07.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:08.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:09.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:10.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:11.057 7fcafec17048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:11.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:12.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:13.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:14.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:15.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:16.059 7fcafec17048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:16.059 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:16.059 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:16.060 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:16.060 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:16.060 7fcafec17048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:16.061 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:16.061 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.061 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:16.061 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.061 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:16.061 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:16:16.062 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:17.764 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:18.765 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:19.767 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:20.059 7fcafec17048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:20.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:21.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:22.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:23.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:24.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:25.062 7fcafec17048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:25.062 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:25.062 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:25.062 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:25.062 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:25.062 7fcafec17048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:25.063 7fcafec17048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:25.063 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.063 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:25.063 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.063 7fcafec17048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.063 7fcafec17048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:16:25.064 7fcafec17048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:25.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:26.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:27.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:28.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:29.063 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:29.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:30.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:31.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:32.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:33.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:34.065 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:34.065 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:34.065 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:34.065 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:34.066 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:34.066 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:34.066 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:34.066 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.067 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:34.067 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.067 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.067 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:16:34.067 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:34.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:35.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:36.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:37.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:38.065 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:38.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:39.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:40.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:41.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:42.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:43.067 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:43.068 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:43.068 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:43.068 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:43.068 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:43.068 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:43.069 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:43.069 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.069 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:43.069 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.069 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.070 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:16:43.070 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:43.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:44.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:45.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:47.068 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:47.765 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:48.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:49.767 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:50.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:51.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:52.071 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:16:52.071 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:16:52.071 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:52.071 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:16:52.072 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:16:52.072 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:16:52.072 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:16:52.073 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.073 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:16:52.073 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.073 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.073 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:16:52.073 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:16:52.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:53.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:54.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:55.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:56.071 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:16:56.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:57.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:58.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:16:59.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:00.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:01.073 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:01.074 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:01.074 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:01.074 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:01.074 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:01.074 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:01.075 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:01.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:02.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:03.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:04.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:05.074 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:05.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:06.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:07.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:08.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:09.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:10.077 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:10.077 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:10.077 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:10.078 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:10.078 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:10.078 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:10.078 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:10.079 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.079 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:10.079 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.079 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.079 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:10.079 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:10.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:11.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:12.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:13.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:14.078 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:14.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:15.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:17.766 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:18.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:19.080 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:19.080 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:19.080 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:19.080 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:19.081 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:19.081 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:19.081 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:19.081 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.081 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:19.081 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.082 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.082 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:19.082 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:19.414 7fcafed5ccc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:17:19.468 7fcafed5ccc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:17:19.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:20.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:21.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:22.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:23.081 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:23.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:24.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:25.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:26.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:27.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:28.084 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:28.084 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:28.084 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:28.085 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:28.085 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:28.085 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:28.086 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:28.086 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.086 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:28.088 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.088 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.088 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:28.088 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:28.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:29.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:30.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:31.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:32.085 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:32.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:33.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:34.743 7fcafebabc18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:17:34.796 7fcafebabc18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:17:34.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:35.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:36.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:37.087 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:37.087 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:37.087 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:37.088 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:37.088 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:37.088 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:37.088 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:37.088 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.088 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:37.089 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.089 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.089 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:37.089 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:37.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:38.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:39.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:40.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:41.088 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:41.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:42.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:43.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:44.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:45.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:46.090 7fcafed5ccc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:46.091 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:46.091 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:46.091 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:46.091 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:46.091 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:46.092 7fcafed5ccc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:47.767 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:48.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:49.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:50.092 7fcafeba50f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:50.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:51.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:52.055 7fcafebab828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:17:52.110 7fcafebab828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:17:52.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:53.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:54.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:55.094 7fcafeba50f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:17:55.094 7fcafeba50f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:17:55.094 7fcafeba50f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:55.095 7fcafeba50f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:17:55.095 7fcafeba50f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:17:55.095 7fcafeba50f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:17:55.095 7fcafeba50f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:17:55.096 7fcafeba50f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.096 7fcafeba50f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:17:55.096 7fcafeba50f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.096 7fcafeba50f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.096 7fcafeba50f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:17:55.097 7fcafeba50f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:17:55.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:56.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:57.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:58.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:17:59.094 7fcafef0bc18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:17:59.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:00.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:01.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:02.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:03.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:04.096 7fcafef0bc18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:04.097 7fcafef0bc18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:04.097 7fcafef0bc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:04.097 7fcafef0bc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:04.097 7fcafef0bc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:04.097 7fcafef0bc18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:04.098 7fcafef0bc18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:04.098 7fcafef0bc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.098 7fcafef0bc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:04.099 7fcafef0bc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.099 7fcafef0bc18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.099 7fcafef0bc18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:04.099 7fcafef0bc18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:04.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:05.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:06.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:07.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:08.097 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:08.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:09.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:10.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:11.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:12.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:13.099 7fcafeb64eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:13.099 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:13.100 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:13.100 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:13.100 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:13.100 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:13.100 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:13.101 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.101 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:13.101 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.101 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.101 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:13.101 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:13.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:14.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:15.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:17.100 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:17.768 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:18.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:19.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:20.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:21.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:22.103 7fcafeb64eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:22.103 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:22.103 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:22.103 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:22.103 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:22.103 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:22.104 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:22.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:23.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:24.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:25.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:26.103 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:26.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:27.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:28.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:29.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:30.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:31.105 7fcafeb64eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:31.106 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:31.106 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:31.106 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:31.106 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:31.106 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:31.107 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:31.107 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.108 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:31.108 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.108 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.108 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:31.108 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:31.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:32.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:33.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:34.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:35.106 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:35.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:36.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:37.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:38.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:39.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:40.109 7fcafeb64eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:40.109 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:40.110 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:40.110 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:40.110 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:40.110 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:40.110 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:40.111 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.111 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:40.111 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.111 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.111 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:40.111 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:40.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:41.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:42.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:43.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:44.110 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:44.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:45.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:47.769 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:48.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:49.112 7fcafeb64eb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:49.113 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:49.113 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:49.113 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:49.113 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:49.113 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:49.114 7fcafeb64eb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:49.114 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.114 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:49.114 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.114 7fcafeb64eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.114 7fcafeb64eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:49.115 7fcafeb64eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:49.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:50.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:51.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:52.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:53.113 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:18:53.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:54.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:55.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:56.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:57.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:58.116 7fcafebab2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:18:58.116 7fcafebab2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:18:58.116 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:58.116 7fcafebab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:18:58.116 7fcafebab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:18:58.116 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:18:58.117 7fcafebab2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:18:58.117 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.117 7fcafebab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:18:58.117 7fcafebab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.117 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.117 7fcafebab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:18:58.118 7fcafebab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:18:58.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:18:59.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:00.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:01.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:02.116 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:02.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:03.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:04.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:05.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:06.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:07.119 7fcafebab2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:07.119 7fcafebab2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:07.119 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:07.119 7fcafebab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:07.120 7fcafebab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:07.120 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:19:07.121 7fcafebab2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:07.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:08.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:09.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:10.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:11.120 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:11.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:12.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:13.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:14.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:15.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:16.122 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:16.122 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:16.122 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:16.122 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:16.122 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:16.122 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:16.123 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:16.123 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.123 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:16.123 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.123 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:16.123 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:19:16.124 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:17.770 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:18.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:19.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:20.122 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:20.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:21.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:22.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:23.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:24.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:25.124 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:25.124 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:25.125 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:25.125 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:25.125 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:25.125 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:25.125 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:25.126 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.126 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:25.126 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.126 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.126 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:19:25.126 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:25.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:26.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:27.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:28.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:29.125 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:29.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:30.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:31.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:32.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:33.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:34.127 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:34.128 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:34.128 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:34.128 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:34.128 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:34.128 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:19:34.129 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:34.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:35.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:36.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:37.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:38.128 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:38.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:39.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:40.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:41.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:42.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:43.130 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:43.131 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:43.131 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:43.131 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:43.131 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:43.131 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:43.132 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:43.132 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.132 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:43.132 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.132 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.133 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:19:43.133 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:43.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:44.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:45.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:47.131 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:47.771 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:48.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:49.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:50.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:51.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:52.133 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:19:52.134 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:19:52.134 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:52.134 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:19:52.134 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:19:52.134 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:19:52.135 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:19:52.135 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.135 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:19:52.135 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.135 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.136 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:19:52.136 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:19:52.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:53.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:54.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:55.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:56.135 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:19:56.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:57.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:58.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:19:59.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:00.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:01.137 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:01.137 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:01.138 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:01.138 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:01.138 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:01.139 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:01.139 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:01.139 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.140 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:01.140 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.140 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.140 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:01.140 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:01.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:02.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:03.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:04.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:05.138 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:05.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:06.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:07.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:08.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:09.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:10.140 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:10.140 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:10.140 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:10.140 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:10.140 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:10.140 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:10.141 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:10.141 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.141 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:10.141 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.141 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.141 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:10.142 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:10.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:11.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:12.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:13.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:14.141 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:14.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:15.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:17.772 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:18.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:19.143 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:19.143 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:19.143 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:19.143 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:19.143 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:19.143 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:19.144 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:19.144 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.144 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:19.144 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.144 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.145 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:19.145 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:19.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:20.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:21.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:22.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:23.143 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:23.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:24.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:25.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:26.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:27.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:28.145 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:28.146 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:28.146 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:28.146 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:28.146 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:28.146 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:28.147 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:28.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:29.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:30.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:31.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:32.147 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:32.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:33.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:34.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:35.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:36.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:37.149 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:37.149 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:37.149 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:37.149 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:37.149 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:37.149 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:37.150 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:37.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:38.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:39.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:40.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:41.149 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:41.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:42.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:43.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:44.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:45.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:46.151 7fcafeb64390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:46.151 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:46.152 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:46.152 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:46.152 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:46.152 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:46.152 7fcafeb64390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:46.153 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:46.153 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:46.153 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:46.153 7fcafeb64390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:46.153 7fcafeb64390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:46.153 7fcafeb64390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:47.773 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:48.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:49.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:50.152 7fcafec10240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:50.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:51.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:52.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:53.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:54.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:55.154 7fcafec10240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:20:55.154 7fcafec10240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:20:55.155 7fcafec10240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:55.155 7fcafec10240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:20:55.155 7fcafec10240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:20:55.155 7fcafec10240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:20:55.155 7fcafec10240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:20:55.155 7fcafec10240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.156 7fcafec10240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:20:55.156 7fcafec10240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.156 7fcafec10240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.156 7fcafec10240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:20:55.156 7fcafec10240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:20:55.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:56.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:57.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:58.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:20:59.155 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:20:59.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:00.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:01.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:02.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:03.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:04.157 7fcafebab4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:04.158 7fcafebab4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:04.158 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:04.158 7fcafebab4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:04.158 7fcafebab4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:04.158 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:04.159 7fcafebab4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:04.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:05.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:06.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:07.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:08.158 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:08.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:09.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:10.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:11.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:12.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:13.160 7fcafebab4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:13.161 7fcafebab4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:13.161 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:13.161 7fcafebab4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:13.161 7fcafebab4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:13.161 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:13.162 7fcafebab4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:13.162 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.162 7fcafebab4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:13.162 7fcafebab4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.162 7fcafebab4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.162 7fcafebab4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:13.163 7fcafebab4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:13.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:14.408 7fcafebd5e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:21:14.461 7fcafebd5e10 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:21:14.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:15.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:17.161 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:17.774 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:18.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:19.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:20.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:21.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:22.163 7fcafebd5e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:22.163 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:22.163 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:22.164 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:22.164 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:22.164 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:22.165 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:22.165 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.165 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:22.165 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.165 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.166 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:22.166 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:22.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:23.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:24.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:25.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:26.163 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:26.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:27.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:28.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:29.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:30.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:31.166 7fcafebd5e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:31.166 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:31.166 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:31.166 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:31.166 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:31.166 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:31.167 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:31.167 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.167 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:31.167 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.167 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.167 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:31.168 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:31.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:32.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:33.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:34.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:35.166 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:35.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:36.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:37.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:38.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:39.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:40.168 7fcafebd5e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:40.169 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:40.169 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:40.169 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:40.169 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:40.169 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:40.170 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:40.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:41.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:42.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:43.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:44.169 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:44.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:45.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:47.775 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:48.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:49.172 7fcafebd5e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:49.173 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:49.173 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:49.173 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:49.173 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:49.173 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:49.174 7fcafebd5e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:49.174 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.174 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:49.174 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.175 7fcafebd5e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.175 7fcafebd5e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:49.175 7fcafebd5e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:49.777 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:50.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:51.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:52.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:53.173 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:21:53.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:54.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:55.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:56.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:57.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:58.175 7fcafed5c0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:21:58.175 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:21:58.175 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:58.175 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:21:58.175 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:21:58.176 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:21:58.176 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:21:58.176 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.176 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:21:58.176 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.176 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.177 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:21:58.177 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:21:58.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:21:59.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:00.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:01.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:02.176 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:02.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:03.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:04.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:05.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:06.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:07.179 7fcafed5c0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:07.179 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:07.179 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:07.180 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:07.180 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:07.180 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:07.180 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:07.181 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.181 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:07.181 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.181 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.181 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:22:07.181 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:07.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:08.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:09.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:10.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:11.179 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:11.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:12.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:13.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:14.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:15.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:16.181 7fcafed5c0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:16.181 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:16.181 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:16.181 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:16.181 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:16.181 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:22:16.182 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:17.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:18.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:19.779 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:20.181 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:20.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:21.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:22.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:23.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:24.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:25.184 7fcafed5c0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:25.184 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:25.184 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:25.185 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:25.185 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:25.185 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:25.185 7fcafed5c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:25.186 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.186 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:25.186 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.186 7fcafed5c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.186 7fcafed5c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:22:25.186 7fcafed5c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:25.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:26.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:27.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:28.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:29.184 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:29.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:30.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:31.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:32.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:33.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:34.187 7fcafebba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:34.187 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:34.187 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:34.187 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:34.188 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:34.188 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:34.188 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:34.188 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.188 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:34.188 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.189 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.189 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:22:34.189 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:34.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:35.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:36.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:37.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:38.187 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:38.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:39.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:40.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:41.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:42.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:43.190 7fcafebba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:43.190 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:43.190 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:43.190 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:43.190 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:43.190 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:22:43.191 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:43.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:44.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:45.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:47.190 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:47.776 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:48.778 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:49.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:50.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:51.475 7fcafebc0978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:22:51.528 7fcafebc0978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:22:51.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:52.192 7fcafebba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:22:52.192 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:22:52.193 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:52.193 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:22:52.193 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:22:52.193 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:22:52.193 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:22:52.193 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.194 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:22:52.194 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.194 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.194 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:22:52.194 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:22:52.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:53.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:54.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:55.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:56.193 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:22:56.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:57.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:58.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:22:59.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:00.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:01.195 7fcafebba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:01.195 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:01.196 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:01.196 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:01.196 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:01.196 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:01.197 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:01.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:02.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:03.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:04.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:05.196 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:05.202 7fcafeba06d8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:23:05.252 7fcafeba06d8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:23:05.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:06.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:07.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:08.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:09.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:10.201 7fcafebba6d8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:10.202 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:10.202 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:10.202 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:10.202 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:10.202 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:10.203 7fcafebba6d8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:10.203 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.204 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:10.204 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.204 7fcafebba6d8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.204 7fcafebba6d8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:10.204 7fcafebba6d8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:10.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:11.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:12.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:13.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:14.201 7fcafee18588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:14.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:15.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:17.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:18.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:19.205 7fcafee18588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:19.205 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:19.205 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:19.206 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:19.206 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:19.206 7fcafee18588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:19.206 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:19.206 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.207 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:19.207 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.207 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.207 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:19.207 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:19.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:20.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:21.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:22.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:23.206 7fcafee18588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:23.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:24.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:25.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:26.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:27.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:28.209 7fcafee18588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:28.209 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:28.209 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:28.209 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:28.209 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:28.209 7fcafee18588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:28.210 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:28.210 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.210 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:28.210 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.210 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.211 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:28.211 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:28.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:29.015 7fcafee18588 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:23:29.070 7fcafee18588 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:23:29.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:30.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:31.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:32.210 7fcafee18588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:32.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:33.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:34.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:35.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:36.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:37.212 7fcafee18588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:37.212 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:37.212 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:37.213 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:37.213 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:37.213 7fcafee18588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:37.213 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:37.214 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.214 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:37.214 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.214 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.214 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:37.214 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:37.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:38.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:39.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:40.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:41.213 7fcafee18588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:41.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:42.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:43.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:44.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:45.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:46.215 7fcafee18588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:46.215 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:46.215 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:46.216 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:46.216 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:46.216 7fcafee18588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:46.217 7fcafee18588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:47.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:48.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:49.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:50.215 7fcaff028978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:50.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:51.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:52.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:53.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:54.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:55.217 7fcaff028978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:23:55.218 7fcaff028978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:23:55.218 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:55.218 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:23:55.218 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:23:55.219 7fcaff028978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:23:55.219 7fcaff028978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:23:55.219 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.219 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:23:55.219 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.220 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.220 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:23:55.220 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:23:55.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:56.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:57.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:58.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:23:59.218 7fcaff028978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:23:59.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:00.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:01.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:02.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:03.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:04.221 7fcaff028978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:04.221 7fcaff028978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:04.221 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:04.221 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:04.222 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.223 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:04.224 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:04.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:05.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:06.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:07.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:08.222 7fcaff028978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:08.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:09.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:10.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:11.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:12.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:13.223 7fcaff028978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:13.224 7fcaff028978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:13.224 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:13.224 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:13.224 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:13.224 7fcaff028978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:13.225 7fcaff028978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:13.226 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.226 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:13.226 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.226 7fcaff028978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.227 7fcaff028978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:13.227 7fcaff028978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:13.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:14.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:15.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:17.224 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:17.780 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:18.781 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:19.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:20.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:21.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:22.227 7fcafee260f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:22.227 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:22.227 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:22.227 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:22.227 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:22.227 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:22.228 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:22.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:23.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:24.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:25.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:26.227 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:26.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:27.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:28.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:29.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:30.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:31.229 7fcafee260f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:31.230 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:31.230 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:31.230 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:31.230 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:31.230 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:31.231 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:31.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:32.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:33.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:34.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:35.230 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:35.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:36.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:37.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:38.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:39.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:40.233 7fcafee260f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:40.233 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:40.233 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:40.234 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:40.234 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:40.234 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:40.234 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:40.234 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.234 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:40.235 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.235 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.235 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:40.235 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:40.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:41.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:42.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:43.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:44.234 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:44.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:45.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:47.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:48.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:49.236 7fcafee260f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:49.237 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:49.237 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:49.237 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:49.237 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:49.237 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:49.237 7fcafee260f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:49.238 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.238 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:49.238 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.238 7fcafee260f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.238 7fcafee260f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:49.238 7fcafee260f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:49.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:50.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:51.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:52.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:53.237 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:24:53.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:54.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:55.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:56.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:57.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:58.239 7fcaff0124e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:24:58.240 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:24:58.240 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:58.240 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:24:58.240 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:24:58.240 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:24:58.240 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:24:58.241 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.241 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:24:58.241 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.241 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.241 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:24:58.241 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:24:58.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:24:59.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:00.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:01.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:02.240 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:02.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:03.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:04.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:05.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:06.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:07.243 7fcaff0124e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:07.243 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:07.243 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:07.243 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:07.243 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:07.244 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:07.244 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:07.244 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.244 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:07.244 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.244 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.245 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:25:07.245 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:07.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:08.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:09.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:10.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:11.244 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:11.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:12.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:13.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:14.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:15.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:16.246 7fcaff0124e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:16.246 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:16.246 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:16.247 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:16.247 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:16.247 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:16.247 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:16.248 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.248 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:16.248 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.248 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:16.248 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:25:16.248 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:17.782 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:18.784 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:19.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:20.247 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:20.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:21.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:22.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:23.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:24.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:25.249 7fcaff0124e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:25.249 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:25.250 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:25.250 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:25.250 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:25.250 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:25.250 7fcaff0124e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:25.251 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.251 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:25.251 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.251 7fcaff0124e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.251 7fcaff0124e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:25:25.251 7fcaff0124e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:25.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:26.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:27.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:28.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:29.250 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:29.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:30.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:31.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:32.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:33.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:34.252 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:34.252 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:34.252 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:34.253 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:34.253 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:34.253 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:34.254 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:34.254 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.254 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:34.254 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.254 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.254 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:25:34.255 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:34.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:35.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:36.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:37.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:38.252 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:38.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:39.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:40.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:41.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:42.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:43.254 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:43.255 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:43.255 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:43.255 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:43.255 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:43.255 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:43.256 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:43.256 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.256 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:43.257 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.257 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.257 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:25:43.257 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:43.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:44.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:45.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:47.255 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:47.783 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:48.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:49.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:50.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:51.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:52.258 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:25:52.258 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:25:52.258 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:52.258 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:25:52.258 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:25:52.258 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:25:52.259 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:25:52.259 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.259 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:25:52.259 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.259 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.260 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:25:52.260 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:25:52.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:53.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:54.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:55.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:56.258 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:25:56.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:57.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:58.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:25:59.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:00.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:01.259 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:01.260 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:01.260 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:01.260 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:01.260 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:01.260 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:01.260 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:01.261 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.261 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:01.261 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.261 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.261 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:01.261 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:01.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:02.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:03.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:04.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:05.260 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:05.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:06.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:07.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:08.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:09.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:10.263 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:10.263 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:10.263 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:10.263 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:10.264 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:10.264 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:10.264 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:10.264 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.265 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:10.265 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.265 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.265 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:10.265 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:10.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:11.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:12.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:13.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:14.264 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:14.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:15.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:17.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:18.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:19.266 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:19.267 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:19.267 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:19.267 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:19.267 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:19.267 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:19.268 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:19.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:20.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:21.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:22.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:23.268 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:23.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:24.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:25.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:26.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:27.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:28.270 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:28.270 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:28.270 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:28.271 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:28.271 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:28.271 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:28.271 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:28.271 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.271 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:28.272 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.272 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.272 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:28.272 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:28.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:29.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:30.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:31.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:32.270 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:32.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:33.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:34.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:35.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:36.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:37.273 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:37.273 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:37.273 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:37.273 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:37.273 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:37.273 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:37.274 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:37.274 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.274 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:37.274 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.274 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.274 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:37.275 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:37.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:38.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:39.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:40.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:41.273 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:41.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:42.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:43.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:44.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:45.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:46.276 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:46.276 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:46.276 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:46.276 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:46.276 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:46.276 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:46.277 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:46.277 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.277 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:46.277 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.277 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:46.277 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:46.278 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:47.785 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:48.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:49.787 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:50.277 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:50.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:51.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:52.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:53.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:54.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:55.279 7fcafeda6780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:26:55.280 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:26:55.280 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:55.280 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:26:55.280 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:26:55.280 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:26:55.281 7fcafeda6780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:26:55.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:56.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:57.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:58.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:26:59.280 7fcafebef390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:26:59.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:00.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:01.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:02.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:03.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:04.282 7fcafebef390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:04.282 7fcafebef390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:04.282 7fcafebef390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:04.283 7fcafebef390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:04.283 7fcafebef390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:04.283 7fcafebef390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:04.283 7fcafebef390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:04.283 7fcafebef390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.284 7fcafebef390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:04.284 7fcafebef390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.284 7fcafebef390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.284 7fcafebef390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:04.284 7fcafebef390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:04.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:05.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:06.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:07.170 7fcafebef390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:27:07.221 7fcafebef390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:27:07.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:08.283 7fcafebef390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:08.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:09.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:10.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:11.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:12.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:13.286 7fcafebef390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:13.286 7fcafebef390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:13.286 7fcafebef390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:13.287 7fcafebef390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:13.287 7fcafebef390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:13.287 7fcafebef390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:13.287 7fcafebef390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:13.287 7fcafebef390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.288 7fcafebef390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:13.288 7fcafebef390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.288 7fcafebef390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.288 7fcafebef390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:13.288 7fcafebef390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:13.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:14.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:15.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:17.287 7fcafeb7a978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:17.786 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:18.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:19.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:20.790 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:21.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:22.289 7fcafeb7a978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:22.290 7fcafeb7a978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:22.290 7fcafeb7a978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:22.290 7fcafeb7a978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:22.290 7fcafeb7a978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:22.290 7fcafeb7a978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:22.291 7fcafeb7a978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:22.291 7fcafeb7a978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.292 7fcafeb7a978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:22.292 7fcafeb7a978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.292 7fcafeb7a978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.292 7fcafeb7a978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:22.292 7fcafeb7a978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:22.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:23.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:24.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:25.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:26.290 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:26.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:27.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:28.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:29.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:30.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:31.293 7fcafee5c4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:31.293 7fcafee5c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:31.293 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:31.294 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:31.294 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:31.294 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:31.294 7fcafee5c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:31.294 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.295 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:31.295 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.295 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.295 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:31.295 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:31.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:32.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:33.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:34.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:35.293 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:35.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:36.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:37.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:38.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:39.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:40.299 7fcafee5c4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:40.299 7fcafee5c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:40.300 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:40.300 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:40.300 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:40.300 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:40.301 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:40.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:41.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:42.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:43.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:44.300 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:44.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:44.889 7fcafebf1978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:27:44.940 7fcafebf1978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:27:45.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:47.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:48.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:49.302 7fcafee5c4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:49.303 7fcafee5c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:49.303 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:49.303 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:49.303 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:49.303 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:49.304 7fcafee5c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:49.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:50.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:51.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:52.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:53.304 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:27:53.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:54.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:55.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:56.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:57.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:58.306 7fcafebe4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:27:58.306 7fcafebe4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:27:58.306 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:58.307 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:27:58.307 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:27:58.307 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:27:58.307 7fcafebe4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:27:58.307 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.307 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:27:58.308 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.308 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.308 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:27:58.308 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:27:58.658 7fcafebe4c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:27:58.710 7fcafebe4c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:27:58.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:27:59.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:00.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:01.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:02.312 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:02.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:03.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:04.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:05.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:06.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:07.316 7fcafebe4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:07.317 7fcafebe4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:07.317 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:07.317 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:07.317 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:07.317 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:07.320 7fcafebe4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:07.320 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.320 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:07.320 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.320 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.321 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:28:07.321 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:07.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:08.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:09.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:10.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:11.320 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:11.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:12.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:13.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:14.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:15.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:16.323 7fcafebe4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:16.323 7fcafebe4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:16.323 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:16.323 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:16.323 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:16.323 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:16.324 7fcafebe4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:16.324 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.324 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:16.324 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.324 7fcafebe4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:16.324 7fcafebe4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:28:16.325 7fcafebe4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:17.403 7fcafebef630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:28:17.456 7fcafebef630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:28:17.788 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:18.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:19.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:20.323 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:20.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:21.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:22.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:23.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:24.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:25.326 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:25.326 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:25.326 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:25.327 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:25.327 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:25.327 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:25.327 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:25.327 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.328 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:25.328 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.328 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.328 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:28:25.328 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:25.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:26.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:27.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:28.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:29.327 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:29.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:30.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:31.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:32.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:33.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:34.330 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:34.330 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:34.330 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:34.331 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:34.331 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:34.331 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:34.331 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:34.332 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.332 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:34.332 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.332 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.332 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:28:34.332 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:34.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:35.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:36.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:37.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:38.330 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:38.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:39.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:40.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:41.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:42.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:43.333 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:43.333 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:43.333 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:43.334 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:43.334 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:43.334 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:43.334 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:43.334 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.335 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:43.335 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.335 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.335 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:28:43.335 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:43.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:44.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:45.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:47.334 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:47.789 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:48.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:49.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:50.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:51.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:52.336 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:28:52.337 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:28:52.337 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:52.337 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:28:52.337 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:28:52.337 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:28:52.338 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:28:52.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:53.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:54.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:55.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:56.337 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:28:56.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:57.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:58.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:28:59.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:00.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:01.339 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:01.339 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:01.339 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:01.340 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:01.340 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:01.340 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:01.340 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:01.340 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.340 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:01.341 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.341 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.341 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:01.341 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:01.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:02.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:03.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:04.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:05.339 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:05.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:06.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:07.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:08.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:09.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:10.341 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:10.341 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:10.342 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:10.342 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:10.342 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:10.342 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:10.342 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:10.342 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.343 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:10.343 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.343 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.343 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:10.343 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:10.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:11.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:12.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:13.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:14.342 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:14.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:15.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:17.791 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:18.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:19.345 7fcafeb6e048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:19.345 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:19.345 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:19.345 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:19.346 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:19.346 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:19.346 7fcafeb6e048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:19.346 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.346 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:19.346 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.347 7fcafeb6e048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.347 7fcafeb6e048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:19.347 7fcafeb6e048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:19.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:20.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:21.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:22.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:23.345 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:23.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:24.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:25.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:26.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:27.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:28.348 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:28.349 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:28.349 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:28.349 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:28.349 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:28.349 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:28.350 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:28.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:29.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:30.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:31.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:32.349 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:32.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:33.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:34.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:35.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:36.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:37.351 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:37.351 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:37.352 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:37.352 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:37.352 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:37.352 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:37.353 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:37.353 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.353 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:37.353 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.353 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.353 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:37.354 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:37.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:38.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:39.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:40.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:41.352 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:41.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:42.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:43.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:44.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:45.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:46.355 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:46.355 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:46.355 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:46.355 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:46.355 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:46.355 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:46.356 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:46.356 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.356 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:46.356 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.356 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:46.356 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:46.357 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:47.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:48.793 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:49.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:50.355 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:50.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:51.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:52.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:53.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:54.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:55.358 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:29:55.358 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:29:55.358 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:55.359 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:29:55.359 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:29:55.359 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:29:55.359 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:29:55.359 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.360 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:29:55.360 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.360 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.360 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:29:55.360 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:29:55.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:56.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:57.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:58.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:29:59.358 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:29:59.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:00.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:01.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:02.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:03.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:04.361 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:04.361 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:04.361 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:04.361 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.362 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.363 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:04.363 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:04.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:05.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:06.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:07.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:08.362 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:08.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:09.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:10.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:11.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:12.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:13.364 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:13.364 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:13.365 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:13.365 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:13.365 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:13.365 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:13.365 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:13.366 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.366 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:13.366 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.366 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.366 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:13.366 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:13.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:14.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:15.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:17.365 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:17.792 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:18.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:19.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:20.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:21.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:22.367 7fcafeb7fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:22.368 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:22.368 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:22.368 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:22.368 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:22.368 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:22.369 7fcafeb7fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:22.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:23.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:24.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:25.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:26.368 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:26.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:27.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:28.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:29.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:30.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:31.370 7fcafec03b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:31.371 7fcafec03b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:31.371 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:31.371 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:31.371 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:31.371 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:31.372 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:31.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:32.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:33.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:34.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:35.372 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:35.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:36.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:37.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:38.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:39.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:40.375 7fcafec03b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:40.375 7fcafec03b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:40.375 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:40.375 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:40.375 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:40.376 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:40.376 7fcafec03b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:40.376 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.376 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:40.377 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.377 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.377 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:40.377 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:40.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:41.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:42.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:43.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:44.375 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:44.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:45.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:47.794 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:48.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:49.378 7fcafec03b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:49.378 7fcafec03b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:49.378 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:49.379 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:49.379 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:49.379 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:49.379 7fcafec03b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:49.379 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.380 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:49.380 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.380 7fcafec03b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.380 7fcafec03b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:49.380 7fcafec03b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:49.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:50.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:51.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:52.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:53.379 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:30:53.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:54.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:55.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:56.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:57.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:58.382 7fcafeb6f588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:30:58.382 7fcafeb6f588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:30:58.382 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:58.382 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:30:58.382 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:30:58.383 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:30:58.383 7fcafeb6f588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:30:58.383 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.383 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:30:58.384 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.384 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.384 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:30:58.384 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:30:58.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:30:59.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:00.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:01.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:02.382 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:02.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:03.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:04.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:05.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:06.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:07.384 7fcafeb6f588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:07.385 7fcafeb6f588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:07.385 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:07.385 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:07.385 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:07.385 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:31:07.386 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:07.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:08.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:09.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:10.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:11.386 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:11.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:12.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:13.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:14.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:15.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:16.388 7fcafeb6f588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:16.389 7fcafeb6f588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:16.389 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:16.389 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:16.389 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:16.389 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:31:16.390 7fcafeb6f588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:17.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:18.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:19.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:20.389 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:20.799 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:21.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:22.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:23.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:24.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:25.392 7fcafeda32e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:25.392 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:25.393 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:25.393 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:25.393 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:25.393 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:25.393 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:25.393 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.394 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:25.394 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.394 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.394 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:31:25.394 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:25.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:26.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:27.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:28.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:29.393 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:29.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:30.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:31.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:32.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:33.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:34.396 7fcafeda32e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:34.396 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:34.396 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:34.396 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:34.396 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:34.397 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:34.397 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:34.397 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.397 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:34.397 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.397 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.398 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:31:34.398 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:34.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:35.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:36.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:37.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:38.397 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:38.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:39.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:40.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:41.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:42.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:43.400 7fcafeda32e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:43.400 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:43.400 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:43.400 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:43.401 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:43.401 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:43.401 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:43.401 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.401 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:43.401 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.402 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.402 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:31:43.402 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:43.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:44.370 7fcafeda32e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:31:44.421 7fcafeda32e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:31:44.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:45.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:47.401 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:47.795 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:48.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:49.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:50.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:51.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:52.403 7fcafeda32e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:31:52.404 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:31:52.404 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:52.404 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:31:52.404 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:31:52.404 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:31:52.405 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:31:52.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:53.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:54.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:55.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:56.404 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:31:56.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:57.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:58.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:31:59.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:00.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:01.406 7fcafeda32e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:01.407 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:01.407 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:01.407 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:01.407 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:01.407 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:01.408 7fcafeda32e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:01.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:02.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:03.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:04.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:05.407 7fcafebea438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:05.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:06.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:07.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:08.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:09.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:10.410 7fcafebea438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:10.410 7fcafebea438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:10.410 7fcafebea438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:10.411 7fcafebea438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:10.411 7fcafebea438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:10.411 7fcafebea438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:10.412 7fcafebea438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:10.412 7fcafebea438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.412 7fcafebea438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:10.412 7fcafebea438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.413 7fcafebea438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.413 7fcafebea438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:10.413 7fcafebea438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:10.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:11.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:12.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:13.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:14.411 7fcafebea438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:14.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:15.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:17.796 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:18.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:19.413 7fcafebea438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:19.413 7fcafebea438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:19.413 7fcafebea438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:19.414 7fcafebea438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:19.414 7fcafebea438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:19.414 7fcafebea438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:19.414 7fcafebea438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:19.414 7fcafebea438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.414 7fcafebea438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:19.415 7fcafebea438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.415 7fcafebea438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.415 7fcafebea438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:19.415 7fcafebea438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:19.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:20.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:21.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:22.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:23.414 7fcafef74390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:23.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:24.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:25.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:25.994 7fcaff699828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:32:26.045 7fcaff699828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:32:26.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:27.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:28.417 7fcafef74390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:28.417 7fcafef74390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:28.417 7fcafef74390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:28.418 7fcafef74390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:28.418 7fcafef74390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:28.418 7fcafef74390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:28.418 7fcafef74390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:28.419 7fcafef74390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.419 7fcafef74390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:28.419 7fcafef74390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.419 7fcafef74390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.419 7fcafef74390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:28.419 7fcafef74390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:28.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:29.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:30.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:31.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:32.417 7fcafee26390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:32.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:33.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:34.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:35.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:36.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:37.419 7fcafee26390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:37.419 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:37.419 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:37.420 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:37.420 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:37.420 7fcafee26390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:37.420 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:37.420 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.421 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:37.421 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.421 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.421 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:37.421 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:37.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:38.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:39.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:39.962 7fcafee26390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:32:40.017 7fcafee26390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:32:40.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:41.420 7fcafee26390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:41.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:42.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:43.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:44.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:45.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:46.423 7fcafee26390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:46.423 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:46.424 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:46.424 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:46.424 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:46.424 7fcafee26390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:46.425 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:47.797 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:48.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:49.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:50.424 7fcafee26390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:50.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:51.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:52.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:53.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:54.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:55.427 7fcafee26390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:32:55.427 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:32:55.428 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:55.428 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:32:55.428 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:32:55.428 7fcafee26390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:32:55.428 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:32:55.429 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.429 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:32:55.429 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.429 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.429 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:32:55.429 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:32:55.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:56.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:56.975 7fcafee26390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:32:57.026 7fcafee26390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:32:57.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:58.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:32:59.428 7fcafee26390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:32:59.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:00.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:01.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:02.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:03.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:04.431 7fcafee26390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:04.432 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:04.432 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:04.432 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:04.432 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:04.432 7fcafee26390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:04.433 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:04.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:05.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:06.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:07.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:08.432 7fcafee26390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:08.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:09.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:10.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:11.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:12.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:13.435 7fcafee26390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:13.435 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:13.435 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:13.435 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:13.435 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:13.435 7fcafee26390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:13.436 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:13.436 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.436 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:13.437 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.437 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.437 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:13.437 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:13.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:14.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:15.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:17.435 7fcafee26390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:17.798 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:18.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:19.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:20.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:21.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:22.438 7fcafee26390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:22.438 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:22.438 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:22.438 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.439 7fcafee26390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.440 7fcafee26390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:22.440 7fcafee26390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:22.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:23.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:24.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:25.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:26.441 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:26.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:27.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:28.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:29.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:30.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:31.444 7fcafef164e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:31.445 7fcafef164e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:31.445 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:31.445 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:31.445 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:31.445 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:31.446 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:31.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:32.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:33.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:34.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:35.445 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:35.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:36.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:37.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:38.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:39.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:40.446 7fcafef164e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:40.447 7fcafef164e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:40.447 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:40.447 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:40.447 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:40.447 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:40.448 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:40.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:41.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:42.854 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:43.855 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:44.447 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:44.857 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:45.859 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:47.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:48.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:49.450 7fcafef164e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:49.450 7fcafef164e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:49.450 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:49.451 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:49.451 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:49.451 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:49.451 7fcafef164e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:49.451 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.452 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:49.452 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.452 7fcafef164e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.452 7fcafef164e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:49.452 7fcafef164e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:49.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:50.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:51.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:52.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:53.450 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:33:53.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:54.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:55.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:56.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:57.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:58.453 7fcafebf00f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:33:58.453 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:33:58.453 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:58.453 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:33:58.454 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:33:58.454 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:33:58.454 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:33:58.454 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.455 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:33:58.455 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.455 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.455 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:33:58.455 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:33:58.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:33:59.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:00.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:01.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:02.453 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:02.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:03.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:04.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:05.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:06.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:07.456 7fcafebf00f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:07.456 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:07.456 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:07.456 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:07.456 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:07.457 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:07.457 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:07.457 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.457 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:07.457 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.457 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.458 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:34:07.458 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:07.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:08.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:09.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:10.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:11.457 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:11.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:12.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:13.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:14.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:15.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:16.460 7fcafebf00f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:16.460 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:16.460 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:16.461 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:16.461 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:16.461 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:34:16.462 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:17.800 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:18.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:19.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:20.460 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:20.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:21.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:22.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:23.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:24.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:25.462 7fcafebf00f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:25.463 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:25.463 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:25.463 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:25.463 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:25.463 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:34:25.464 7fcafebf00f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:25.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:26.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:27.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:28.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:29.463 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:29.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:30.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:31.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:32.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:33.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:34.466 7fcafec768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:34.467 7fcafec768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:34.467 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:34.467 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:34.467 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:34.467 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:34.467 7fcafec768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:34.468 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.468 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:34.468 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.468 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.468 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:34:34.468 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:34.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:35.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:36.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:37.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:38.467 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:38.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:39.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:40.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:41.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:42.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:43.470 7fcafec768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:43.470 7fcafec768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:43.471 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:43.471 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:43.471 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:43.471 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:43.472 7fcafec768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:43.472 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.472 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:43.472 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.472 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.472 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:34:43.473 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:43.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:44.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:45.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:47.472 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:47.801 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:48.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:49.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:50.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:51.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:52.475 7fcafec768d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:34:52.475 7fcafec768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:34:52.475 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:52.475 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:34:52.475 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:34:52.475 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:34:52.476 7fcafec768d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:34:52.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:53.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:54.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:55.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:56.475 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:34:56.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:57.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:58.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:34:59.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:00.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:01.478 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:01.478 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:01.478 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:01.478 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:01.478 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:01.478 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:01.479 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:01.479 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.479 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:01.479 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.479 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.480 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:01.480 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:01.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:02.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:03.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:04.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:05.479 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:05.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:06.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:07.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:08.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:09.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:10.482 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:10.482 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:10.482 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:10.483 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:10.483 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:10.483 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:10.483 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:10.483 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.484 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:10.484 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.484 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.484 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:10.484 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:10.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:11.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:12.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:13.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:14.483 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:14.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:15.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:17.802 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:18.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:19.486 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:19.486 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:19.486 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:19.486 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.487 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.488 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:19.488 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:19.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:20.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:21.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:22.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:23.486 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:23.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:24.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:25.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:26.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:27.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:28.489 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:28.489 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:28.489 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:28.490 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:28.490 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:28.490 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:28.491 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:28.491 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.491 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:28.491 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.491 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.492 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:28.492 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:28.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:29.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:30.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:31.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:32.490 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:32.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:33.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:34.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:35.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:36.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:37.492 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:37.493 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:37.493 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:37.493 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:37.493 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:37.493 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:37.494 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:37.494 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.494 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:37.495 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.495 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.495 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:37.495 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:37.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:38.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:39.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:40.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:41.493 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:41.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:42.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:43.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:44.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:45.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:46.496 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:46.496 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:46.496 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:46.496 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:46.496 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:46.496 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:46.497 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:46.497 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.497 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:46.497 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.497 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:46.497 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:46.498 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:47.803 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:48.804 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:49.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:50.497 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:50.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:51.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:52.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:53.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:54.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:55.499 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:35:55.500 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:35:55.500 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:55.500 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:35:55.500 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:35:55.501 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:35:55.501 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:35:55.501 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.502 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:35:55.502 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.502 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.502 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:35:55.502 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:35:55.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:56.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:57.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:58.245 7fcafec03438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:35:58.297 7fcafec03438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:35:58.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:35:59.501 7fcafec03438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:35:59.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:00.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:01.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:02.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:03.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:04.503 7fcafec03438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:04.504 7fcafec03438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:04.504 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:04.504 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:04.504 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:04.504 7fcafec03438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:04.505 7fcafec03438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:04.505 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.505 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:04.506 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.506 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.506 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:04.506 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:04.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:05.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:06.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:07.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:08.504 7fcafec03438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:08.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:09.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:10.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:11.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:12.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:13.507 7fcafec03438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:13.507 7fcafec03438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:13.507 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:13.507 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:13.507 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:13.507 7fcafec03438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:13.508 7fcafec03438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:13.508 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.508 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:13.508 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.508 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.509 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:13.509 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:13.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:14.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:15.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:17.507 7fcafec03438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:17.805 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:18.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:19.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:20.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:21.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:22.509 7fcafec03438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:22.510 7fcafec03438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:22.510 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:22.510 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:22.510 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:22.510 7fcafec03438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:22.511 7fcafec03438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:22.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:23.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:24.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:25.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:26.510 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:26.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:27.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:28.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:29.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:30.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:31.512 7fcafeb72588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:31.512 7fcafeb72588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:31.513 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:31.513 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:31.514 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:31.514 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:31.515 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:31.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:32.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:33.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:34.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:35.513 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:35.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:36.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:37.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:38.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:39.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:40.516 7fcafeb72588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:40.516 7fcafeb72588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:40.517 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:40.517 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:40.517 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:40.517 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:40.517 7fcafeb72588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:40.518 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.518 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:40.518 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.518 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.518 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:40.518 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:40.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:41.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:42.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:43.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:44.517 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:44.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:45.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:47.806 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:48.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:49.519 7fcafeb72588 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:49.520 7fcafeb72588 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:49.520 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:49.520 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:49.520 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:49.520 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:49.521 7fcafeb72588 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:49.521 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.521 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:49.521 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.521 7fcafeb72588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.522 7fcafeb72588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:49.522 7fcafeb72588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:49.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:50.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:51.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:52.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:53.521 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:36:53.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:54.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:55.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:56.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:57.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:58.524 7fcafec1a780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:36:58.524 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:36:58.524 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:58.525 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:36:58.525 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:36:58.525 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:36:58.525 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:36:58.525 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.526 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:36:58.526 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.526 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.526 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:36:58.526 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:36:58.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:36:59.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:00.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:01.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:02.525 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:02.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:03.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:04.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:05.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:06.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:07.527 7fcafec1a780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:07.527 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:07.527 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:07.527 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:07.527 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:07.528 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:07.528 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:07.528 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.528 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:07.528 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.529 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.529 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:37:07.529 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:07.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:08.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:09.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:10.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:11.528 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:11.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:12.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:13.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:14.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:15.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:16.531 7fcafec1a780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:16.531 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:16.531 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:16.531 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:16.532 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:16.532 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:16.532 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:16.532 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.532 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:16.532 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.533 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:16.533 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:37:16.533 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:17.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:18.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:19.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:20.531 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:20.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:21.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:22.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:23.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:24.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:25.535 7fcafec1a780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:25.535 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:25.535 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:25.535 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:25.535 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:25.535 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:37:25.536 7fcafec1a780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:25.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:26.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:27.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:28.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:29.536 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:29.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:30.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:31.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:32.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:33.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:34.538 7fcafeb76390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:34.539 7fcafeb76390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:34.539 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:34.539 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:34.539 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:34.539 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:37:34.540 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:34.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:35.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:36.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:37.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:38.540 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:38.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:39.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:40.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:41.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:42.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:43.542 7fcafeb76390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:43.542 7fcafeb76390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:43.542 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:43.543 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:43.543 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:43.543 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:43.543 7fcafeb76390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:43.543 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.543 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:43.544 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.544 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.544 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:37:43.544 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:43.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:44.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:45.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:47.543 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:47.807 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:48.808 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:49.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:50.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:51.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:52.545 7fcafeb76390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:37:52.545 7fcafeb76390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:37:52.545 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:52.545 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:37:52.545 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:37:52.545 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:37:52.546 7fcafeb76390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:37:52.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:53.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:54.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:55.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:56.546 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:37:56.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:57.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:58.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:37:59.466 7fcafeda6b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:37:59.517 7fcafeda6b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:37:59.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:00.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:01.549 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:01.549 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:01.549 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:01.549 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:01.549 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:01.549 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:01.550 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:01.550 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.550 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:01.550 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.550 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.550 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:01.551 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:01.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:02.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:03.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:04.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:05.550 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:05.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:06.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:07.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:08.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:09.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:10.553 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:10.559 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:10.560 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:10.560 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:10.560 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:10.560 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:10.561 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:10.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:11.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:12.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:13.484 7fcafebf9b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:38:13.537 7fcafebf9b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:38:13.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:14.554 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:14.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:15.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:17.809 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:18.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:19.557 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:19.558 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:19.558 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:19.558 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:19.558 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:19.558 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:19.559 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:19.559 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.559 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:19.560 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.560 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.560 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:19.560 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:19.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:20.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:21.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:22.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:23.559 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:23.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:24.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:25.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:26.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:27.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:28.562 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:28.562 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:28.562 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:28.562 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:28.562 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:28.562 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:28.563 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:28.563 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.563 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:28.563 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.563 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.564 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:28.564 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:28.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:29.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:30.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:30.845 7fcafebf9b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:38:30.899 7fcafebf9b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:38:31.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:32.562 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:32.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:33.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:34.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:35.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:36.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:37.565 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:37.566 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:37.566 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:37.566 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:37.566 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:37.566 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:37.567 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:37.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:38.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:39.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:40.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:41.566 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:41.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:42.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:43.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:44.851 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:45.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:46.568 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:46.569 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:46.569 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:46.569 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:46.569 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:46.569 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:46.570 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:47.810 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:48.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:49.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:50.570 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:50.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:51.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:52.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:53.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:54.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:55.573 7fcafebf9b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:38:55.573 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:38:55.573 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:55.574 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:38:55.574 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:38:55.574 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:38:55.574 7fcafebf9b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:38:55.575 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.575 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:38:55.575 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.575 7fcafebf9b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.575 7fcafebf9b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:38:55.575 7fcafebf9b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:38:55.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:56.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:57.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:58.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:38:59.574 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:38:59.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:00.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:01.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:02.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:03.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:04.578 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:04.578 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:04.578 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:04.579 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:04.579 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:04.579 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:04.580 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:04.580 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.580 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:04.580 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.580 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.580 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:04.581 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:04.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:05.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:06.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:07.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:08.579 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:08.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:09.861 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:10.866 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:11.868 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:12.870 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:13.581 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:13.581 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:13.581 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:13.581 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.582 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.583 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:13.583 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:13.871 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:14.874 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:15.875 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:17.582 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:17.811 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:18.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:19.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:20.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:21.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:22.586 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:22.586 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:22.586 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:22.586 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:22.586 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:22.587 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:22.587 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:22.587 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.587 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:22.587 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.587 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.588 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:22.588 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:22.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:23.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:24.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:25.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:26.587 7fcafec01240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:26.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:27.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:28.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:29.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:30.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:31.590 7fcafec01240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:31.590 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:31.590 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:31.591 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:31.591 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:31.591 7fcafec01240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:31.592 7fcafec01240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:31.592 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.592 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:31.592 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.593 7fcafec01240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.593 7fcafec01240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:31.593 7fcafec01240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:31.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:32.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:33.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:34.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:35.591 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:35.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:36.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:37.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:38.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:39.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:40.593 7fcafeb89780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:40.593 7fcafeb89780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:40.593 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:40.594 7fcafeb89780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:40.594 7fcafeb89780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:40.594 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:40.595 7fcafeb89780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:40.595 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.595 7fcafeb89780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:40.595 7fcafeb89780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.596 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.596 7fcafeb89780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:40.596 7fcafeb89780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:40.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:41.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:42.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:43.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:44.594 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:44.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:45.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:47.812 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:48.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:49.597 7fcafeb89780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:49.597 7fcafeb89780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:49.597 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:49.598 7fcafeb89780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:49.598 7fcafeb89780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:49.598 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:49.599 7fcafeb89780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:49.599 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.599 7fcafeb89780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:49.599 7fcafeb89780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.599 7fcafeb89780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.600 7fcafeb89780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:49.600 7fcafeb89780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:49.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:50.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:51.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:52.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:53.598 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:39:53.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:54.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:55.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:56.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:57.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:58.601 7fcafebb4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:39:58.601 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:39:58.601 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:58.602 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:39:58.602 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:39:58.602 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:39:58.603 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:39:58.603 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.603 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:39:58.603 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.603 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.603 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:39:58.604 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:39:58.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:39:59.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:00.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:01.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:02.602 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:02.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:03.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:04.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:05.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:06.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:07.605 7fcafebb4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:07.605 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:07.605 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:07.605 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:07.605 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:07.606 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:07.606 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:07.606 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.606 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:07.606 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.606 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.607 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:40:07.607 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:07.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:08.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:09.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:10.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:11.606 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:11.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:12.851 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:13.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:14.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:15.854 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:16.608 7fcafebb4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:16.608 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:16.608 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.609 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:16.609 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:16.609 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:16.610 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:16.610 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.610 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:16.610 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.611 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:16.611 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:40:16.611 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:17.813 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:18.815 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:19.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:20.609 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:20.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:21.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:22.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:23.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:24.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:25.032 7fcafeb81390 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:40:25.087 7fcafeb81390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:40:25.611 7fcafebb4c18 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:25.612 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:25.612 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:25.612 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:25.612 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:25.613 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:25.613 7fcafebb4c18 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:25.613 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.613 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:25.614 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.614 7fcafebb4c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.614 7fcafebb4c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:40:25.614 7fcafebb4c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:25.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:26.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:27.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:28.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:29.612 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:29.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:30.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:31.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:32.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:33.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:34.615 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:34.615 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:34.615 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:34.616 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:34.616 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:34.616 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:40:34.617 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:34.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:35.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:36.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:37.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:38.615 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:38.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:39.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:40.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:41.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:42.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:43.618 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:43.618 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:43.618 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:43.618 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:43.618 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:43.618 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:40:43.619 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:43.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:44.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:45.855 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:47.618 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:47.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:48.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:49.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:50.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:51.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:52.621 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:40:52.622 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:40:52.622 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:52.622 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:40:52.622 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:40:52.622 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:40:52.623 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:40:52.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:53.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:54.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:55.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:56.622 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:40:56.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:57.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:58.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:40:59.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:00.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:01.624 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:01.625 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:01.625 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:01.625 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:01.625 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:01.625 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:01.626 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:01.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:02.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:03.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:04.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:05.625 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:05.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:06.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:07.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:08.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:09.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:10.628 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:10.628 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:10.628 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:10.628 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:10.628 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:10.628 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:10.629 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:10.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:11.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:12.851 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:13.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:14.628 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:14.854 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:15.856 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:17.814 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:18.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:19.631 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:19.631 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:19.632 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:19.632 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:19.632 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:19.632 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:19.632 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:19.632 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.633 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:19.633 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.633 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.633 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:19.633 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:19.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:20.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:21.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:22.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:23.633 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:23.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:24.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:25.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:26.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:27.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:28.634 7fcafeb89ac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:28.635 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:28.635 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:28.635 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:28.635 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:28.635 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:28.636 7fcafeb89ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:28.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:29.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:30.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:31.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:32.635 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:32.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:33.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:34.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:35.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:36.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:37.638 7fcafebb4438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:37.638 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:37.638 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:37.639 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:37.639 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:37.639 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:37.639 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:37.639 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.639 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:37.640 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.640 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.640 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:37.640 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:37.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:38.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:39.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:40.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:41.640 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:41.851 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:42.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:43.855 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:44.856 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:45.858 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:46.642 7fcafebb4438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:46.643 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:46.643 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:46.643 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:46.643 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:46.643 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:46.644 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:47.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:48.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:49.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:50.643 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:50.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:51.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:52.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:53.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:54.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:55.646 7fcafebb4438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:41:55.646 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:41:55.647 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:55.647 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:41:55.647 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:41:55.647 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:41:55.647 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:41:55.648 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.648 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:41:55.648 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.648 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.648 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:41:55.648 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:41:55.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:56.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:57.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:58.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:41:59.647 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:41:59.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:00.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:01.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:02.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:03.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:04.650 7fcafebb4438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:04.650 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:04.650 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:04.650 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:04.650 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:04.650 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:04.651 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:04.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:05.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:06.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:07.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:08.651 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:08.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:09.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:10.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:11.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:12.854 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:13.654 7fcafebb4438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:13.654 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:13.654 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:13.654 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:13.654 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:13.654 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:13.655 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:13.655 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.655 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:13.655 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.655 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.655 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:13.656 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:13.856 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:14.858 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:15.859 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:17.654 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:17.816 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:18.817 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:19.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:20.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:21.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:22.656 7fcafebb4438 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:22.657 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:22.657 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:22.657 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:22.657 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:22.657 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:22.658 7fcafebb4438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:22.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:23.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:24.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:25.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:26.657 7fcafeb64828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:26.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:27.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:28.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:29.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:30.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:31.660 7fcafeb64828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:31.660 7fcafeb64828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:31.661 7fcafeb64828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:31.661 7fcafeb64828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:31.661 7fcafeb64828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:31.661 7fcafeb64828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:31.662 7fcafeb64828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:31.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:32.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:33.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:34.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:35.661 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:35.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:36.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:37.844 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:38.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:39.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:40.663 7fcafeb82978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:40.663 7fcafeb82978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:40.663 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:40.664 7fcafeb82978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:40.664 7fcafeb82978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:40.664 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:40.664 7fcafeb82978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:40.664 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.665 7fcafeb82978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:40.665 7fcafeb82978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.665 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.665 7fcafeb82978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:40.665 7fcafeb82978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:40.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:41.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:42.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:43.854 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:44.665 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:44.856 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:45.857 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:47.818 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:48.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:49.667 7fcafeb82978 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:49.668 7fcafeb82978 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:49.668 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:49.668 7fcafeb82978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:49.669 7fcafeb82978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:49.669 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:49.669 7fcafeb82978 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:49.669 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.670 7fcafeb82978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:49.670 7fcafeb82978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.670 7fcafeb82978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.670 7fcafeb82978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:49.670 7fcafeb82978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:49.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:50.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:51.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:52.825 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:53.669 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:42:53.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:54.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:55.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:56.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:57.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:58.672 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:42:58.673 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:42:58.673 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:58.673 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:42:58.673 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:42:58.673 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:42:58.674 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:42:58.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:42:59.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:00.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:01.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:02.673 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:02.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:03.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:04.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:05.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:06.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:07.675 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:07.676 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:07.677 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:07.677 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:07.677 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:07.677 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:07.678 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:07.678 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.678 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:07.679 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.679 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.679 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:43:07.679 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:07.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:08.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:09.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:10.850 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:11.676 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:11.851 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:12.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:13.855 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:14.857 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:15.859 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:16.679 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:16.679 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:16.679 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.679 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:16.680 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:16.680 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:16.680 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:16.681 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.681 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:16.681 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.681 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:16.681 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:43:16.681 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:17.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:18.821 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:19.823 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:20.680 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:20.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:21.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:22.827 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:23.829 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:24.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:25.683 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:25.683 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:25.683 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:25.684 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:25.684 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:25.684 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:25.684 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:25.684 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.684 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:25.685 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.685 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.685 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:43:25.685 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:25.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:26.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:27.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:28.836 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:29.684 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:29.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:30.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:31.840 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:32.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:33.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:34.687 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:34.687 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:34.687 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:34.687 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:34.687 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:34.687 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:34.688 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:34.688 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.688 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:34.688 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.688 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.688 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:43:34.689 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:34.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:35.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:36.848 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:37.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:38.688 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:38.851 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:39.852 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:40.853 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:41.855 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:42.857 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:43.690 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:43.690 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:43.690 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:43.690 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:43.690 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:43.691 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:43.691 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:43.691 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.691 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:43.691 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.691 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.692 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:43:43.692 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:43.858 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:44.860 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:45.862 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:47.690 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:47.819 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:48.820 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:49.822 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:50.824 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:51.826 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:52.694 7fcafefbe240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:43:52.694 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:43:52.694 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:52.694 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:43:52.695 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:43:52.695 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:43:52.695 7fcafefbe240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:43:52.695 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.695 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:43:52.695 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.696 7fcafefbe240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.696 7fcafefbe240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:43:52.696 7fcafefbe240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:43:52.828 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:53.830 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:54.831 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:55.832 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:55.888 7fcafefbe240 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:43:55.944 7fcafefbe240 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:43:56.694 7fcafec06240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:43:56.833 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:56.904 7fcafee18630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 10/21/2024 02:43:56.955 7fcafee18630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 10/21/2024 02:43:57.834 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:58.835 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:43:59.837 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:00.838 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:01.697 7fcafec06240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 10/21/2024 02:44:01.698 7fcafec06240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 10/21/2024 02:44:01.698 7fcafec06240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:01.698 7fcafec06240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 10/21/2024 02:44:01.698 7fcafec06240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 10/21/2024 02:44:01.698 7fcafec06240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-439-1 process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://252.30.117.243:5050/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-439-1:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1729476084738358 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 8 >> 10/21/2024 02:44:01.699 7fcafec06240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 10/21/2024 02:44:01.839 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:02.841 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:03.842 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:04.843 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:05.699 7fcafec06240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 10/21/2024 02:44:05.845 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:06.846 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:07.847 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process. 10/21/2024 02:44:08.849 7fcaff27f198 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiError: KombuAmqpClient: socket.timeout occurred while draining events, no events to process.