01/16/2025 00:52:58.373 7f083a460dc8 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/16/2025 00:52:58.373 7f083a460dc8 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/16/2025 00:52:58.373 7f083a460dc8 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/16/2025 00:52:58.374 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.43:2181,10.0.0.29:2181,10.0.0.23:2181 01/16/2025 00:52:58.374 7f083a460dc8 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 00:52:58.375 7f083124ce10 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 01/16/2025 00:52:58.375 7f083124ce10 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 01/16/2025 00:52:58.375 7f0831250780 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 01/16/2025 00:52:58.375 7f0831250780 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 00:52:58.375 7f0831250780 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/16/2025 00:52:58.375 7f0831250780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.375 7f0831250780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988778375600 collector_name = collector_ip = collector_list = [ 10.0.0.43:8086, 10.0.0.23:8086, 10.0.0.29:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 01/16/2025 00:52:58.376 7f0831250780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.383 7f083127c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.383 7f083127c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:52:58.383 7f083127c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.451 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.43:9041', '10.0.0.29:9041', '10.0.0.23:9041'] 01/16/2025 00:52:58.451 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 01/16/2025 00:52:58.452 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 01/16/2025 00:52:58.452 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 01/16/2025 00:52:58.452 7f0837a514e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.452 7f0837a514e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:52:58.452 7f0837a514e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.453 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 01/16/2025 00:52:58.503 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 01/16/2025 00:52:58.504 7f08312834e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.504 7f08312834e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:52:58.504 7f08312834e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.510 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 01/16/2025 00:52:58.511 7f083123c390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.511 7f083123c390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:52:58.511 7f083123c390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:52:58.532 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:52:59.424 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid', created 01/16/2025 00:52:59.432 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:01.158 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:01.848 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'config_db_uuid' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 01/16/2025 00:53:01.854 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:02.376 7f083123c0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:02.377 7f083123c0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:02.378 7f083123c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:02.379 7f083123c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:02.379 7f083123c0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:02.379 7f083123c0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988778375600 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.23:8086, 10.0.0.29:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:02.379 7f083123c0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:03.237 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:04.325 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent', created 01/16/2025 00:53:04.331 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:05.889 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:06.380 7f083117cb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:06.384 7f083117cb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:06.384 7f083117cb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:06.384 7f083117cb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:06.384 7f083117cb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:06.384 7f083117cb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:06.384 7f083117cb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988778375600 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.23:8086, 10.0.0.29:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:06.385 7f083117cb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:06.577 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: keyspace 'useragent' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 01/16/2025 00:53:06.584 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:06.584 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 01/16/2025 00:53:06.634 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 01/16/2025 00:53:09.324 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:10.384 7f08386c9630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:10.386 7f08386c9630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:10.386 7f08386c9630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:10.386 7f08386c9630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:10.386 7f08386c9630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:10.386 7f08386c9630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:10.386 7f08386c9630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988778375600 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.23:8086, 10.0.0.29:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:10.387 7f08386c9630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:10.741 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table', created 01/16/2025 00:53:10.748 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:11.521 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:12.227 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'obj_shared_table' fixed with properties {'gc_grace_seconds': 864000} 01/16/2025 00:53:12.234 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:13.434 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:14.223 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table', created 01/16/2025 00:53:14.229 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:14.387 7f083123c2e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:14.388 7f083123c2e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:14.388 7f083123c2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:14.388 7f083123c2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:14.388 7f083123c2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988778375600 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.43:8086, 10.0.0.23:8086, 10.0.0.29:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:14.389 7f083123c2e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:14.744 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock acquired. Performing schema change... 01/16/2025 00:53:15.505 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: table 'useragent_keyval_table' fixed with properties {'gc_grace_seconds': 864000} 01/16/2025 00:53:15.520 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Zookeeper lock released. 01/16/2025 00:53:15.521 7f0831166240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.521 7f0831166240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:15.521 7f0831166240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.693 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.43:5673//', 'pyamqp://guest:guest@10.0.0.29:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 01/16/2025 00:53:15.701 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 01/16/2025 00:53:15.702 7f0830880780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.702 7f0830880780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:15.702 7f0830880780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.702 7f0830880780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.702 7f0830880780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:15.702 7f0830880780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.706 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 01/16/2025 00:53:15.716 7f08307574e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.716 7f08307574e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:15.717 7f08307574e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.868 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 01/16/2025 00:53:15.869 7f08306e1978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.869 7f08306e1978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:15.869 7f08306e1978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.874 7f083a460dc8 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 01/16/2025 00:53:15.874 7f0830880cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.875 7f0830880cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:15.875 7f0830880cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.876 7f0830880cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 01/16/2025 00:53:15.877 7f083075f0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.877 7f083075f0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:15.877 7f083075f0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.888 7f0830880cc0 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 01/16/2025 00:53:15.888 7f083078d438 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:15.888 7f083078d438 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:15.888 7f083078d438 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.464 7f984f115d48 [contrail-api] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/16/2025 00:53:27.470 7f984f115d48 [contrail-api] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/16/2025 00:53:27.470 7f984f115d48 [contrail-api] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/16/2025 00:53:27.470 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to zookeeper on 10.0.0.43:2181,10.0.0.29:2181,10.0.0.23:2181 01/16/2025 00:53:27.471 7f984f115d48 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 00:53:27.473 7f9845ed1eb8 [contrail-api] [ERROR]: Cannot write http_port 8084 to /tmp/contrail-api.0.http_port 01/16/2025 00:53:27.473 7f9845ed1eb8 [contrail-api] [ERROR]: Starting Introspect on HTTP Port 8084 01/16/2025 00:53:27.473 7f9845ed3828 [contrail-api] [INFO]: Processing event[EvStart] in state[none] 01/16/2025 00:53:27.473 7f9845ed3828 [contrail-api] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[] connection down >>, ] >> 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 2 max_sm_queue_count = 2 >> 01/16/2025 00:53:27.474 7f9845ed3828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.489 7f9845efb198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.489 7f9845efb198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:53:27.489 7f9845efb198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.528 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Connecting to database on ['10.0.0.43:9041', '10.0.0.29:9041', '10.0.0.23:9041'] 01/16/2025 00:53:27.529 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: VNCCassandra started with driver cql 01/16/2025 00:53:27.529 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: initializing cassandra cluster 01/16/2025 00:53:27.529 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster before create 01/16/2025 00:53:27.529 7f9845e9d828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.529 7f9845e9d828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:27.529 7f9845e9d828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.535 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster created 01/16/2025 00:53:27.620 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster DB connected 01/16/2025 00:53:27.622 7f9845eb92e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.622 7f9845eb92e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Initializing description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Zookeeper:Zookeeper[], Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:27.622 7f9845eb92e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.638 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster init KS 01/16/2025 00:53:27.638 7f984a6c08d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.638 7f984a6c08d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:Cassandra[] connection down >>, ] >> 01/16/2025 00:53:27.638 7f984a6c08d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.661 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster KS are ready 01/16/2025 00:53:27.726 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: CassandraDriverCQL.__init__Cluster CF are ready 01/16/2025 00:53:27.727 7f9845d54390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.727 7f9845d54390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:53:27.727 7f9845d54390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.840 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.43:5673//', 'pyamqp://guest:guest@10.0.0.29:5673//', 'pyamqp://guest:guest@10.0.0.23:5673//'] 01/16/2025 00:53:27.850 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection down 01/16/2025 00:53:27.851 7f984545ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.851 7f984545ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:27.851 7f984545ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.851 7f984545ec18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.851 7f984545ec18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:27.851 7f984545ec18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.864 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ drainer connection ESTABLISHED 01/16/2025 00:53:27.865 7f984545e0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:27.865 7f984545e0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:53:27.865 7f984545e0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.095 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 01/16/2025 00:53:28.095 7f98454862e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.095 7f98454862e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:28.096 7f98454862e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.124 7f984f115d48 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 01/16/2025 00:53:28.124 7f984545e0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.124 7f984545e0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:53:28.125 7f984545e0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.127 7f9845376390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection down 01/16/2025 00:53:28.128 7f9845427780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.128 7f9845427780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/16/2025 00:53:28.128 7f9845427780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.143 7f9845376390 [contrail-api] [WARNING]: __default__ [SYS_NOTICE]: VncApiNotice: RabbitMQ publish connection ESTABLISHED 01/16/2025 00:53:28.144 7f9845430198 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.144 7f9845430198 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/16/2025 00:53:28.144 7f9845430198 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.593 7f984cb2fa20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Executing db_resync on api-server instance 10.0.0.43_0 01/16/2025 00:53:28.593 7f984cb2fa20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Contrail Version is(nightly-r24.1-centos) 01/16/2025 00:53:28.604 7f984cb2fa20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: zk_sync_node data (nightly-r24.1-centos) 01/16/2025 00:53:28.608 7f984cb2fa20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: DBERESYNC: running walk 01/16/2025 00:53:28.621 7f984cb2fa20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: Cassandra DB walk completed. 01/16/2025 00:53:28.658 7f984cb2fa20 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Time elapsed in resyncing db: 0:00:00.064801 01/16/2025 00:53:28.659 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-policy-management', 'default-application-policy-set'], 'oper': 'UPDATE', 'request-id': 'req-f9b1ee80-58a5-43ac-8c19-f720dcae2aea', 'type': 'application_policy_set', 'uuid': 'e1a333b5-1701-4c8d-a916-c677aa75ffe6'} 01/16/2025 00:53:28.668 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 01/16/2025 00:53:28.669 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-network-ipam'], 'oper': 'UPDATE', 'request-id': 'req-7170d760-c151-4dc4-a9df-75ed6ff65215', 'type': 'network_ipam', 'uuid': '98784737-b8c9-4eba-85a3-c4eaba369068'} 01/16/2025 00:53:28.669 7f984dd07d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.670 7f984dd07d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-policy-management:default-application-policy-set elements = { all_applications : truefq_name : ["default-policy-management", "default-application-policy-set"]global_vrouter_config_refs : [{"to": ["default-global-system-config", "default-global-vrouter-config"], "attr": null, "uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c"}]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16258895932605680781, "uuid_lslong": 12184144059160723430}, "enable": true, "created": "2025-01-16T00:53:16.411357", "last_modified": "2025-01-16T00:53:28.254016", "description": null, "user_visible": true, "creator": null}parent_type : "policy-management"parent_uuid : "b237b741-ad09-4fa1-9371-0e33e9a6e04e"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "e1a333b5-1701-4c8d-a916-c677aa75ffe6" } deleted = False >> 01/16/2025 00:53:28.670 7f984dd07d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.680 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project'], 'oper': 'UPDATE', 'request-id': 'req-affb2f19-7697-4f72-8965-91cfebdb6a82', 'type': 'project', 'uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca'} 01/16/2025 00:53:28.691 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectProjectTable:ContrailConfigTrace] map 01/16/2025 00:53:28.692 7f984545eeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.692 7f984545eeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project elements = { fq_name : ["default-domain", "default-project"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2541139833087805612, "uuid_lslong": 10816179985503364298}, "enable": true, "created": "2025-01-16T00:53:16.209638", "last_modified": "2025-01-16T00:53:28.645096", "description": null, "user_visible": true, "creator": null}parent_type : "domain"parent_uuid : "07731a0e-4f6c-4fa5-943d-8ffb72d4caae"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}quota : {"defaults": -1}uuid : "2343f136-f3cb-48ac-961a-ca63e69e24ca" } deleted = False >> 01/16/2025 00:53:28.692 7f984545eeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.907 7f984f115d48 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 01/16/2025 00:53:28.908 7f984ca88ac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:28.908 7f984ca88ac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ModuleCpuStateTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. build_info = {"build-info" : [{"build-version" : "nightly.r24.1.centos", "build-time" : "2025-01-13 00:14:41.510749", "build-user" : "root", "build-hostname" : "jenkins-build-prepare-sandbox-7419-1.novalocal", "build-id" : "1", "build-number" : "centos"}]} config_node_ip = [ 10.0.0.43, 10.20.0.27, 172.17.0.1, ] >> 01/16/2025 00:53:28.908 7f984ca88ac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:29.038 7f98452d6f60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:29.038 7f98452d6f60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Generic Connection:Keystone[] connection down >>, ] >> 01/16/2025 00:53:29.038 7f98452d6f60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:29.068 7f9845d950f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting consumer greenlet 01/16/2025 00:53:29.068 7f9845d950f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 01/16/2025 00:53:29.069 7f9845d954e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Starting publisher greenlet 01/16/2025 00:53:29.069 7f9845d954e0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Publisher connection 01/16/2025 00:53:29.070 7f984f115d48 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Added consumer: amqp_request.cn-jenkins-deploy-platform-ansible-os-2646-1..dummy 01/16/2025 00:53:29.070 7f984f115d48 [contrail-api] [DEBUG]: Add uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 00:53:29.073 7f984775c588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:29.073 7f984775c588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ConfigApiWorkerTrace: data = << name = worker-0 worker_id = 0 introspect_port = 8084 admin_port = 8095 introspect_url = http://10.0.0.43:8084 >> 01/16/2025 00:53:29.073 7f984775c588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:29.094 7f9845d950f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 01/16/2025 00:53:29.095 7f9845d954e0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Publisher connection established 01/16/2025 00:53:29.219 7f9845d950f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2646-1..dummy'] 01/16/2025 00:53:29.269 7f9845d950f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Ensuring Consumer connection 01/16/2025 00:53:29.280 7f9845d950f0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiInfo: KombuAmqpClient: Consumer connection established 01/16/2025 00:53:29.398 7f9845d950f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: KombuAmqpClient: Created consumers ['amqp_request.cn-jenkins-deploy-platform-ansible-os-2646-1..dummy'] 01/16/2025 00:53:29.456 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'obj_dict': {'config_database_node_ip_address': '10.0.0.43', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'id_perms': {'created': '2025-01-16T00:53:29.438568', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:29.438568', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9286836489848448403, 'uuid_mslong': 14565731117904710575}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ca23df47-7890-4baf-80e1-7895708d6593'}, 'oper': 'CREATE', 'request-id': 'req-1d1fa659-0304-4326-a6de-40830cd029dd', 'type': 'config_database_node', 'uuid': 'ca23df47-7890-4baf-80e1-7895708d6593'} 01/16/2025 00:53:29.457 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:53:29.458 7f9844fcbcc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:29.458 7f9844fcbcc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. elements = { config_database_node_ip_address : "10.0.0.43"display_name : "cn-jenkins-deploy-platform-ansible-os-2646-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 14565731117904710575, "uuid_lslong": 9286836489848448403}, "enable": true, "created": "2025-01-16T00:53:29.438568", "last_modified": "2025-01-16T00:53:29.438568", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "22978d74-648d-4342-9707-c760fd7f98ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "ca23df47-7890-4baf-80e1-7895708d6593" } deleted = False >> 01/16/2025 00:53:29.458 7f9844fcbcc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.116 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_config_template'], 'obj_dict': {'display_name': 'Device Config Push', 'fq_name': ['default-global-system-config', 'fabric_config_template'], 'id_perms': {'created': '2025-01-16T00:53:31.058546', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.058546', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10328361284507497211, 'uuid_mslong': 13788392466806685737}}, 'job_template_concurrency_level': 'device', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"device_management_ip": {"type": ' '"string", "description": ' '"Management IP of the Device"}, ' '"device_abstract_config": {"type": ' '"object", "description": "JSON ' 'string of the device abstract ' 'config derived from VNC data ' 'model"}, ' '"additional_feature_params": ' '{"type": "object", ' '"additionalProperties": false, ' '"description": "Additional feature ' 'specific parameters that are not ' 'defined in the VNC data model. ' 'These could be vendor specific ' 'parameters.", "properties": ' '{"basic": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"ntp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"ntp_boot_servers": {"type": ' '"array", "items": {"type": ' '"string", "title": "NTP Boot ' 'server", "examples": ' '["6.6.6.6"]}}, "ntp_servers": ' '{"type": "array", "items": ' '{"type": "string", "title": "NTP ' 'server", "examples": ' '["8.8.8.8"]}}, "time_zone": ' '{"type": "string", "title": "Time ' 'Zone", "examples": ' '["America/Los_Angeles"]}}}, ' '"name_servers": {"type": "array", ' '"additionalProperties": false, ' '"items": {"type": "string", ' '"Title": "Domain Name Server", ' '"examples": ["10.1.1.2", ' '"11.1.1.2"]}}, "domain_name": ' '{"type": "string", "title": ' '"Domain Name", "examples": ' '["company.net"]}, "snmp": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"communities": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string"}, "readonly": {"type": ' '"boolean", "default": true}}, ' '"required": ["name"]}}}}, ' '"static_routes": {"type": "array", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"required": ["subnets", ' '"nexthop"], "properties": ' '{"subnets": {"type": "array", ' '"items": {"type": "string", ' '"title": "Subnet", "examples": ' '["10.1.1.0/24", "10.1.2.0/24"]}}, ' '"nexthop": {"type": "string", ' '"title": "Next hop IP", ' '"examples": ["10.1.1.254"]}}}}}}, ' '"underlay_ip_clos": {"type": ' '"object", "additionalProperties": ' 'false, "properties": ' '{"bgp_hold_time": {"type": ' '"integer", "default": 90}}}}}, ' '"is_delete": {"type": "boolean", ' '"description": "Set to true for ' 'config delete operation", ' '"default": false}, ' '"manage_underlay": {"type": ' '"boolean", "description": "Set to ' 'true to manage underlay config", ' '"default": true}, ' '"enterprise_style": {"type": ' '"boolean", "description": "Set to ' 'true to if enterprise-style ' 'config", "default": true}, ' '"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_uuid": ' '{"type": "string", "format": ' '"uuid"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bf5a35e4-ffaf-4029-8f55-b5ddc2f772fb'}, 'oper': 'CREATE', 'request-id': 'req-ac53758c-f9ed-4db1-bf77-b5c27b8fd43d', 'type': 'job_template', 'uuid': 'bf5a35e4-ffaf-4029-8f55-b5ddc2f772fb'} 01/16/2025 00:53:31.474 7f9844f8ff60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:31.476 7f9844f8ff60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:31.476 7f9844f8ff60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:31.476 7f9844f8ff60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:31.476 7f9844f8ff60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Generic Connection:Keystone[] connection down >>, ] >> 01/16/2025 00:53:31.476 7f9844f8ff60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:31.476 7f9844f8ff60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Generic Connection:Keystone[] connection down >>, ] >> 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:31.477 7f9844f8ff60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.484 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ztp_template'], 'obj_dict': {'display_name': 'ZTP', 'fq_name': ['default-global-system-config', 'ztp_template'], 'id_perms': {'created': '2025-01-16T00:53:31.462916', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.462916', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11279646086924158924, 'uuid_mslong': 4512731420312617961}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"type": "object", "definitions": ' '{}, "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"properties": {"fabric_uuid": ' '{"$id": ' '"/properties/input/properties/fabric_uuid", ' '"format": "uuid", "type": ' '"string", "title": "The ' 'Fabric_uuid Schema", ' '"description": "UUID of the fabric ' 'object created", "default": "", ' '"examples": ["123456789"]}, ' '"device_count": {"$id": ' '"/properties/input/properties/device_count", ' '"type": "integer", "title": "The ' 'Device Count Schema", ' '"description": "Number of devices ' 'to discover", "default": 0, ' '"examples": [1, 2, 3, 4, 5]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': ''}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3ea07151-3a7a-43e9-9c89-5a5a9b3d47cc'}, 'oper': 'CREATE', 'request-id': 'req-63fe735c-1bca-4862-8bda-ce47073b441e', 'type': 'job_template', 'uuid': '3ea07151-3a7a-43e9-9c89-5a5a9b3d47cc'} 01/16/2025 00:53:31.508 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:fabric_deletion_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "fabric_deletion_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/delete_fabric.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"fabric info\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"required\": [\"fabric_fq_name\"], \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Fabric Deletion", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:31.563 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'obj_dict': {'display_name': 'Fabric Deletion', 'fq_name': ['default-global-system-config', 'fabric_deletion_template'], 'id_perms': {'created': '2025-01-16T00:53:31.543199', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.543199', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13466738897609616693, 'uuid_mslong': 16776647249526803918}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/delete_fabric.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e8d29fc9-7614-4dce-bae3-77ad72f4ed35'}, 'oper': 'CREATE', 'request-id': 'req-8a546bcc-974a-47d1-9690-2069be48ae40', 'type': 'job_template', 'uuid': 'e8d29fc9-7614-4dce-bae3-77ad72f4ed35'} 01/16/2025 00:53:31.639 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device_deletion_template'], 'obj_dict': {'display_name': 'Device Deletion', 'fq_name': ['default-global-system-config', 'device_deletion_template'], 'id_perms': {'created': '2025-01-16T00:53:31.619524', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.619524', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13597765547654931700, 'uuid_mslong': 1210113900126883830}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "devices": ' '{"type": "array", "description": ' '"List of device names", "items": ' '{"type": "string"}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/delete_fabric_devices.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '10cb302e-42d3-4ff6-bcb4-f7b8b70464f4'}, 'oper': 'CREATE', 'request-id': 'req-9ff67a3a-64a2-4311-a4fd-b783740af910', 'type': 'job_template', 'uuid': '10cb302e-42d3-4ff6-bcb4-f7b8b70464f4'} 01/16/2025 00:53:31.769 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'role_assignment_template'], 'obj_dict': {'display_name': 'Role Assignment', 'fq_name': ['default-global-system-config', 'role_assignment_template'], 'id_perms': {'created': '2025-01-16T00:53:31.711810', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.711810', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12682772375097707863, 'uuid_mslong': 12186744109295161062}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"role_assignments"], "properties": ' '{"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "role_assignments": ' '{"type": "array", "minItems": 0, ' '"description": "Fabric device role ' 'assignments", "items": {"type": ' '"object", "properties": ' '{"device_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "physical_role": ' '{"type": "string", "enum": ' '["leaf", "spine", "pnf", ' '"superspine"]}, ' '"routing_switching_roles": ' '{"type": "array", "items": ' '{"type": "string", "enum": ' '["CRB"]}}}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/role_assignment.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'config', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a9200333-031f-4ee6-b002-424768d60d57'}, 'oper': 'CREATE', 'request-id': 'req-7aba49df-5984-4f17-be7a-b4fb67c9b5b4', 'type': 'job_template', 'uuid': 'a9200333-031f-4ee6-b002-424768d60d57'} 01/16/2025 00:53:31.799 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:topology_discovery_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "topology_discovery_template"], "parent_type": "global-system-config", "job_template_type": "workflow", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/topology_discovery.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Topology Discovery", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:31.858 7f985497e630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.858 7f985497e630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:31.858 7f985497e630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:31.898 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'obj_dict': {'display_name': 'Topology Discovery', 'fq_name': ['default-global-system-config', 'topology_discovery_template'], 'id_perms': {'created': '2025-01-16T00:53:31.837611', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.837611', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10433545186817543022, 'uuid_mslong': 15614093139374196325}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd8b066fb-b643-4665-90cb-6611703f0b6e'}, 'oper': 'CREATE', 'request-id': 'req-c2b64768-f144-420e-8237-933038fa80a4', 'type': 'job_template', 'uuid': 'd8b066fb-b643-4665-90cb-6611703f0b6e'} 01/16/2025 00:53:31.940 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-01-16T00:53:31.927895', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.927895', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12024275230434095579, 'uuid_mslong': 7460601990781616780}}, 'parent_type': 'security-group', 'parent_uuid': 'ff297d84-5324-4b67-b6eb-25ac1c1080df', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '678961fb-8f1c-428c-a6de-ce9d5f8d71db'}, 'oper': 'CREATE', 'request-id': 'req-44af97b1-0402-444f-963a-8e993e337c8e', 'type': 'access_control_list', 'uuid': '678961fb-8f1c-428c-a6de-ce9d5f8d71db'} 01/16/2025 00:53:31.962 7f9844fcbcc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = http://10.0.0.43:8082/access-control-lists operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-schema remote_ip = 10.0.0.23 body = {"access-control-list": {"uuid": null, "fq_name": ["default-domain", "default-project", "__no_rule__", "egress-access-control-list"], "parent_type": "security-group", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "egress-access-control-list"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.002 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-01-16T00:53:31.992036', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.992036', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13617540096044515661, 'uuid_mslong': 9748741767224902443}}, 'parent_type': 'security-group', 'parent_uuid': 'ff297d84-5324-4b67-b6eb-25ac1c1080df', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '874a7cfc-7a74-432b-bcfb-38918b5f414d'}, 'oper': 'CREATE', 'request-id': 'req-18d133de-902c-499b-af03-2617ae363775', 'type': 'access_control_list', 'uuid': '874a7cfc-7a74-432b-bcfb-38918b5f414d'} 01/16/2025 00:53:32.035 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'obj_dict': {'display_name': 'Fabric Onboarding', 'fq_name': ['default-global-system-config', 'fabric_onboard_template'], 'id_perms': {'created': '2025-01-16T00:53:31.966199', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:31.966199', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9789360260487133063, 'uuid_mslong': 12256929557280997939}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"management_subnets", ' '"loopback_subnets", ' '"fabric_subnets", ' '"fabric_asn_pool", "device_auth", ' '"node_profiles"], "properties": ' '{"fabric_fq_name": {"type": ' '"array", "items": {"type": ' '"string"}}, "fabric_display_name": ' '{"type": "string"}, ' '"fabric_cluster_id": {"type": ' '"integer"}, "management_subnets": ' '{"type": "array", "items": ' '{"type": "object", "description": ' '"List of the management network ' 'subnets for the fabric", ' '"additionalProperties": false, ' '"required": ["cidr", "gateway"], ' '"properties": {"cidr": {"type": ' '"string", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}, ' '"gateway": {"type": "string", ' '"format": "ipv4"}}}}, ' '"loopback_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that fabric ' 'device loopback ips can be ' 'allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"overlay_loopback_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'fabric device overlay loopback ips ' 'can be allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that could be ' 'carved out for the p2p networks ' 'between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"pnf_servicechain_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for service ' 'chaining between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_asn_pool": {"type": ' '"array", "items": {"title": "eBGP ' 'ASN Pool for fabric underlay ' 'network", "type": "object", ' '"description": "List of the ASN ' 'pools that could be used to ' 'configure the eBGP peers for the ' 'IP fabric", "properties": ' '{"asn_min": {"type": "integer"}, ' '"asn_max": {"type": "integer"}}, ' '"required": ["asn_min", ' '"asn_max"]}}, "overlay_ibgp_asn": ' '{"type": "integer", "title": "iBGP ' 'ASN for Contrail overlay network", ' '"default": 64512}, "device_auth": ' '{"title": "Device Auth", "type": ' '"object", "additionalProperties": ' 'false, "required": ' '["root_password"], "properties": ' '{"root_password": {"type": ' '"string"}}}, "node_profiles": ' '{"type": "array", "items": ' '{"title": "Node profile", "type": ' '"object", "description": "List of ' 'node profiles to be used by the ' 'fabric.", "additionalProperties": ' 'false, "properties": ' '{"node_profile_name": {"type": ' '"string"}, "serial_nums": {"type": ' '"array", "description": "Optional ' 'list of serial numbers of fabric ' 'devices that we want to associate ' 'with this node profile.", "items": ' '{"type": "string"}}}, "required": ' '["node_profile_name"]}}, ' '"interface_filters": {"type": ' '"array", "items": {"type": ' '"object", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}, ' '"import_configured": {"type": ' '"boolean", "default": false, ' '"description": "Not importing ' 'configured interfaces by default. ' 'Set this option to true if ' 'configured interfaces need to be ' 'imported as part of onboarding."}, ' '"device_count": {"title": "Number ' 'of fabric devices", "type": ' '"integer", "description": "Total ' 'number of devices in the fabric ' 'that needs to be zero-touch ' 'provisioned"}, "ztp_timeout": ' '{"title": "Value of ZTP timeout in ' 'seconds", "type": "integer", ' '"description": "Value of ZTP ' 'timeout in seconds"}, ' '"retry_timeout": {"title": "Value ' 'of retry timeout in seconds", ' '"type": "integer", "description": ' '"Value of retry timeout in ' 'seconds"}, ' '"supplemental_day_0_cfg": ' '{"title": "List of day 0 config ' 'that can be used to supplement the ' 'ZTP config", "type": "array", ' '"items": {"type": "object", ' '"required": ["name", "cfg"], ' '"properties": {"name": {"title": ' '"name for the config", "type": ' '"string"}, "cfg": {"title": ' '"config blob that contains the ' 'supplemental day-0 config", ' '"type": "string"}}}}, ' '"device_to_ztp": {"title": "List ' 'of device serial numbers for the ' 'devices to be ZTPed", "type": ' '"array", "items": {"type": ' '"object", "required": ' '["serial_number", "hostname"], ' '"properties": {"serial_number": ' '{"title": "Device serial number", ' '"type": "string"}, "hostname": ' '{"title": "Device hostname can be ' 'optionally specified.", "type": ' '"string", "pattern": ' '"^(([a-zA-Z0-9]|[a-zA-Z0-9][a-zA-Z0-9\\\\-]*[a-zA-Z0-9])\\\\.)*([A-Za-z0-9]|[A-Za-z0-9][A-Za-z0-9\\\\-]*[A-Za-z0-9])$"}, ' '"underlay_asn": {"title": ' '"Underlay eBGP autonomous system ' 'number", "type": ["integer", ' '"string"]}, "loopback_ip": ' '{"title": "Loopback IP address", ' '"type": "string", "format": ' '"ipv4"}, "mgmt_ip": {"title": ' '"Management IP address", "type": ' '"string", "format": "ipv4"}, ' '"to_ztp": {"title": "Include or ' 'ignore device in ZTP workflow", ' '"type": "boolean"}, ' '"supplemental_day_0_cfg": ' '{"title": "Name(s) of the ' 'supplemental day-0 config(s) that ' 'can be optionally specified for ' 'this device", "type": ["string", ' '"array"], "items": {"type": ' '"string"}}}}}, "os_version": ' '{"type": "string"}, ' '"enterprise_style": {"type": ' '"boolean", "default": true, ' '"description": "True if enterprise ' 'style, false if sp-style ' 'configuration"}, ' '"disable_vlan_vn_uniqueness_check": ' '{"type": "boolean", "default": ' 'false, "description": "True if ' 'vlan-vn uniqueness validation ' 'checks needs to be disabled, false ' 'if enable all complex ' 'validations"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/fabric_onboard.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': True, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 4, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/role_assignment_dfg.yml', 'refresh_token': False, 'sequence_no': 5, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': 6, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': 7, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 8, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 9, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 10, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aa195c7e-0ab8-4233-87da-cb4a68a93787'}, 'oper': 'CREATE', 'request-id': 'req-d2e14715-340c-4a64-9624-046c23fa4987', 'type': 'job_template', 'uuid': 'aa195c7e-0ab8-4233-87da-cb4a68a93787'} 01/16/2025 00:53:32.109 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-01-16T00:53:32.098528', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.098528', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10997334332893405869, 'uuid_mslong': 216488456103085860}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '03011f1a-93ff-4724-989e-614f3451a2ad'}, 'oper': 'CREATE', 'request-id': 'req-7581bf87-30a6-4c0c-88ca-0bc0817d06d2', 'type': 'route_target', 'uuid': '03011f1a-93ff-4724-989e-614f3451a2ad'} 01/16/2025 00:53:32.127 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'obj_dict': {'display_name': 'Search using IP or MAC', 'fq_name': ['default-global-system-config', 'search_ip_mac_template'], 'id_perms': {'created': '2025-01-16T00:53:32.109090', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.109090', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13743337508849619728, 'uuid_mslong': 15016063115987996234}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to locate an ' 'interface in a fabric given an IP ' 'or MAC', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"ip_address": ' '{"$id": "/properties/ip_address", ' '"title": "IP Address", "pattern": ' '"^\\\\s*(([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5]).){3}([0-9]|[1-9][0-9]|1[0-9]{2}|2[0-4][0-9]|25[0-5])\\\\s*$", ' '"type": "string"}, "mac_address": ' '{"$id": "/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}}', 'job_template_input_ui_schema': '{"ip_address": {"ui:help": ' '"Enter an IP Address. The field ' 'value must include a IPv4 ' 'address without subnet mask; ' 'for example, 192.168.3.120", ' '"ui:placeholder": "Enter IP ' 'address"}, "mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Search ip or mac schema ' 'command Playbook Output", "type": ' '"object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"interface_names": {"type": ' '"array", "title": "Interfaces ' 'Name(s)", "description": "Display ' 'Interface Names that belong to ' 'this mac_address.", "items": ' '{"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string", "title": "Interface ' 'Name", "description": "Interface ' 'name"}, "device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "Device name on ' 'which the interface was learnt"}, ' '"loopback_ip": {"type": "string", ' '"title": "Source Loopback IP", ' '"description": "Originating ' 'source\'s loopback ip address"}}, ' '"description": "Name of each ' 'interface that belongs under this ' 'mac_address"}}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd063c5d8-714f-4e4a-beba-24a623489310'}, 'oper': 'CREATE', 'request-id': 'req-ccd7bf26-532a-4024-91a4-bb8d4376d24a', 'type': 'job_template', 'uuid': 'd063c5d8-714f-4e4a-beba-24a623489310'} 01/16/2025 00:53:32.156 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_interface_details_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_interface_details_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"interface_details\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Interface Details\", \"type\": \"object\", \"properties\": {\"interface_type\": {\"type\": \"string\", \"title\": \"Interface Type\", \"enum\": [\"physical\", \"logical\"], \"default\": \"physical\"}}, \"required\": [\"interface_type\"]}, \"conditional\": {\"title\": \"Sub Operation Type\", \"$ref\": \"#/definitions/sub_command\"}}, \"definitions\": {\"sub_command\": {\"title\": \"Sub Operation Type\", \"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"Show runtime interfaces\", \"Show configured interfaces\", \"Show interfaces by names\"], \"default\": \"Show runtime interfaces\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"Show runtime interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show configured interfaces\"]}, \"interface_filters\": {\"$id\": \"/properties/interface_filters\", \"title\": \"Interface Filters\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"title\": \"Filter\", \"maxProperties\": 2, \"additionalProperties\": false, \"properties\": {\"op\": {\"enum\": [\"regex\"], \"title\": \"Filter Type\"}, \"expr\": {\"type\": \"string\", \"title\": \"Filter Expression\"}}, \"default\": {}, \"examples\": [{\"op\": \"regex\", \"expr\": \"^ge-\"}, {\"op\": \"regex\", \"expr\": \"^xe\"}]}}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"Show interfaces by names\"]}, \"interface_names\": {\"$id\": \"/properties/interface_names\", \"title\": \"Interface Names\", \"type\": \"array\", \"items\": {\"$id\": \"/properties/interface_names/items\", \"type\": \"string\", \"pattern\": \"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$\", \"title\": \"Interface Name\"}, \"examples\": [\"ge-0/0/1\", \"xe-0/0/0\"]}}, \"required\": [\"interface_names\"]}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show Interface Details Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces details sub-command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"oneOf\": [{\"properties\": {\"interface_stats_rt_phy\": {\"type\": \"array\", \"title\": \"Runtime Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"op_status\": {\"type\": \"string\", \"title\": \"Operational Status\", \"description\": \"Operational status of the interface\"}, \"admin_status\": {\"type\": \"string\", \"title\": \"Admin Status\", \"description\": \"Admin status of the interface\"}, \"input_rate\": {\"type\": \"string\", \"title\": \"InputRate (bps)\", \"description\": \"Input packets rate in bits per second if present\"}, \"output_rate\": {\"type\": \"string\", \"title\": \"OutputRate (bps)\", \"description\": \"Output packets rate in bits per second if present\"}}}}}}, {\"properties\": {\"interface_stats_log\": {\"type\": \"array\", \"title\": \"Logical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}, \"address_family\": {\"type\": \"string\", \"title\": \"Address Family\", \"description\": \"Address family if present\"}}}}}}, {\"properties\": {\"interface_stats_cf_phy\": {\"type\": \"array\", \"title\": \"Configured Physical Interfaces Statistics\", \"description\": \"Display statistics and detailed output\", \"items\": {\"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"name\": {\"type\": \"string\", \"title\": \"Interface\", \"description\": \"Interface name\"}}}}}}]}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to get a list of physical or logical interfaces from a device and interfaces' other related information.", "display_name": "Show Interface Details", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.162 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-d6aebb0d-b7c7-4b72-97ec-586eca965ce8', 'type': 'routing_instance', 'uuid': 'bdf828ca-4f8d-4fd0-a7e7-0cfb5f6b6394'} 01/16/2025 00:53:32.201 7f9844fcbcc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = route_target identifier_name = target:64512:8000001 url = http://10.0.0.43:8082/route-targets operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-schema remote_ip = 10.0.0.23 body = {"route-target": {"uuid": null, "fq_name": ["target:64512:8000001"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "target:64512:8000001"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.225 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-01-16T00:53:32.213871', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.213871', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11815380071962896857, 'uuid_mslong': 9248746607357808089}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '805a2609-9529-4dd9-a3f8-a9932b93e9d9'}, 'oper': 'CREATE', 'request-id': 'req-bcfb948e-8cd1-4cfb-9a1a-59673d1f11c5', 'type': 'route_target', 'uuid': '805a2609-9529-4dd9-a3f8-a9932b93e9d9'} 01/16/2025 00:53:32.251 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'obj_dict': {'display_name': 'Show Interface Details', 'fq_name': ['default-global-system-config', 'show_interface_details_template'], 'id_perms': {'created': '2025-01-16T00:53:32.190870', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.190870', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12917811082257700661, 'uuid_mslong': 12403445130492332014}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to get a list ' 'of physical or logical interfaces ' "from a device and interfaces' other " 'related information.', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": ' '{"interface_details": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Interface Details", ' '"type": "object", "properties": ' '{"interface_type": {"type": ' '"string", "title": "Interface ' 'Type", "enum": ["physical", ' '"logical"], "default": ' '"physical"}}, "required": ' '["interface_type"]}, ' '"conditional": {"title": "Sub ' 'Operation Type", "$ref": ' '"#/definitions/sub_command"}}, ' '"definitions": {"sub_command": ' '{"title": "Sub Operation Type", ' '"type": "object", "properties": ' '{"sub_operation": {"title": ' '"Choose a sub-operation", "type": ' '"string", "enum": ["Show runtime ' 'interfaces", "Show configured ' 'interfaces", "Show interfaces by ' 'names"], "default": "Show runtime ' 'interfaces"}}, "required": ' '["sub_operation"], "dependencies": ' '{"sub_operation": {"oneOf": ' '[{"properties": {"sub_operation": ' '{"enum": ["Show runtime ' 'interfaces"]}, ' '"interface_filters": {"$id": ' '"/properties/interface_filters", ' '"title": "Interface Filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "title": ' '"Filter", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"], "title": "Filter ' 'Type"}, "expr": {"type": "string", ' '"title": "Filter Expression"}}, ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["Show configured ' 'interfaces"]}, ' '"interface_filters": {"$id": ' '"/properties/interface_filters", ' '"title": "Interface Filters", ' '"type": "array", "items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "title": ' '"Filter", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"], "title": "Filter ' 'Type"}, "expr": {"type": "string", ' '"title": "Filter Expression"}}, ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["Show interfaces by ' 'names"]}, "interface_names": ' '{"$id": ' '"/properties/interface_names", ' '"title": "Interface Names", ' '"type": "array", "items": {"$id": ' '"/properties/interface_names/items", ' '"type": "string", "pattern": ' '"^([a-z]{1,}[0-9]{0,}(-[0-9]{1,}/[0-9]{1,}/[0-9]{1,})?(\\\\.[0-9]{1,})?)$", ' '"title": "Interface Name"}, ' '"examples": ["ge-0/0/1", ' '"xe-0/0/0"]}}, "required": ' '["interface_names"]}]}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show Interface Details ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces details ' 'sub-command executed on the ' 'device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "oneOf": ' '[{"properties": ' '{"interface_stats_rt_phy": ' '{"type": "array", "title": ' '"Runtime Physical Interfaces ' 'Statistics", "description": ' '"Display statistics and detailed ' 'output", "items": {"type": ' '"object", "additionalProperties": ' 'false, "properties": {"name": ' '{"type": "string", "title": ' '"Interface", "description": ' '"Interface name"}, "op_status": ' '{"type": "string", "title": ' '"Operational Status", ' '"description": "Operational ' 'status of the interface"}, ' '"admin_status": {"type": ' '"string", "title": "Admin ' 'Status", "description": "Admin ' 'status of the interface"}, ' '"input_rate": {"type": "string", ' '"title": "InputRate (bps)", ' '"description": "Input packets ' 'rate in bits per second if ' 'present"}, "output_rate": ' '{"type": "string", "title": ' '"OutputRate (bps)", ' '"description": "Output packets ' 'rate in bits per second if ' 'present"}}}}}}, {"properties": ' '{"interface_stats_log": {"type": ' '"array", "title": "Logical ' 'Interfaces Statistics", ' '"description": "Display ' 'statistics and detailed output", ' '"items": {"type": "object", ' '"additionalProperties": false, ' '"properties": {"name": {"type": ' '"string", "title": "Interface", ' '"description": "Interface name"}, ' '"address_family": {"type": ' '"string", "title": "Address ' 'Family", "description": "Address ' 'family if present"}}}}}}, ' '{"properties": ' '{"interface_stats_cf_phy": ' '{"type": "array", "title": ' '"Configured Physical Interfaces ' 'Statistics", "description": ' '"Display statistics and detailed ' 'output", "items": {"type": ' '"object", "additionalProperties": ' 'false, "properties": {"name": ' '{"type": "string", "title": ' '"Interface", "description": ' '"Interface name"}}}}}}]}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ac21e3a1-420b-47ee-b345-48bce1931735'}, 'oper': 'CREATE', 'request-id': 'req-397bd805-2313-4db1-b27d-78574ae2ef2f', 'type': 'job_template', 'uuid': 'ac21e3a1-420b-47ee-b345-48bce1931735'} 01/16/2025 00:53:32.296 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-31ad1b2a-22bb-42c2-98cf-880bc1ef1a56', 'type': 'routing_instance', 'uuid': 'ce144911-4afa-43bc-bf61-23f9436ac17a'} 01/16/2025 00:53:32.366 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_config_template'], 'obj_dict': {'display_name': ' Show current or rollback configuration', 'fq_name': ['default-global-system-config', 'show_config_template'], 'id_perms': {'created': '2025-01-16T00:53:32.312662', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.312662', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13609763430910452879, 'uuid_mslong': 9444382747479196325}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'current or previous configuration', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"config_type": ' '{"$id": "/properties/config_type", ' '"title": "Configuration type", ' '"type": "string", "enum": ' '["current", "rollback 1", ' '"rollback 2"], "default": ' '"current"}, "config_filter": ' '{"$id": ' '"/properties/config_filter", ' '"title": "Configuration filter", ' '"type": "string", "enum": ["all", ' '"system", "system/login", ' '"system/services", ' '"system/syslog", "interfaces", ' '"chassis", "services", "snmp", ' '"forwarding-options", ' '"event-options", "policy-options", ' '"class-of-service", "firewall", ' '"protocols", "routing-instances", ' '"routing-options", ' '"switch-options", "vlans"], ' '"default": "all"}, ' '"compare_configurations": {"$id": ' '"/properties/compare_configurations", ' '"title": "Compare selected ' 'configuration with current", ' '"type": "boolean", "default": ' 'false}}, "required": ' '["config_type", "config_filter", ' '"compare_configurations"]}', 'job_template_input_ui_schema': '{"config_type": {"ui:help": ' '"Select one type at a time"}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show configuration ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Device ' 'Configuration", "description": ' '"Display Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '83113012-0253-42a5-bcdf-97bb9884e48f'}, 'oper': 'CREATE', 'request-id': 'req-73f5024f-b20b-4386-8046-df86ec228746', 'type': 'job_template', 'uuid': '83113012-0253-42a5-bcdf-97bb9884e48f'} 01/16/2025 00:53:32.374 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-01-16T00:53:32.355571', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.355571', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11016646862260772482, 'uuid_mslong': 4427661751389406293}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '3d7236e7-7526-4455-98e2-fdf3d8f99e82'}, 'oper': 'CREATE', 'request-id': 'req-3bb4d2ba-eb37-411c-bf2d-22424adb8fd2', 'type': 'route_target', 'uuid': '3d7236e7-7526-4455-98e2-fdf3d8f99e82'} 01/16/2025 00:53:32.383 7f9844fcbcc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = ede3eb45-1d4e-4256-a4ef-6aad33cf6220 object_type = routing_instance identifier_name = default-domain:default-project:default-virtual-network:default-virtual-network url = http://10.0.0.43:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-schema remote_ip = 10.0.0.23 body = {"type": "routing-instance", "uuid": "ede3eb45-1d4e-4256-a4ef-6aad33cf6220", "ref-type": "route-target", "ref-uuid": "3d7236e7-7526-4455-98e2-fdf3d8f99e82", "ref-fq-name": ["target:64512:8000002"], "operation": "ADD", "attr": {"import_export": null}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.419 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-8010cd27-cb05-4e41-9ac5-d4e29c2e2dab', 'type': 'routing_instance', 'uuid': 'ede3eb45-1d4e-4256-a4ef-6aad33cf6220'} 01/16/2025 00:53:32.477 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-01-16T00:53:32.466357', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.466357', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13489752177049729539, 'uuid_mslong': 653465789513354747}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '091193ac-60d0-4dfb-bb35-3a221d19fa03'}, 'oper': 'CREATE', 'request-id': 'req-b7ff965e-f778-499a-a1b6-146367296897', 'type': 'route_target', 'uuid': '091193ac-60d0-4dfb-bb35-3a221d19fa03'} 01/16/2025 00:53:32.486 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'obj_dict': {'display_name': 'Test overlay connectivity', 'fq_name': ['default-global-system-config', 'test_overlay_connectivity_template'], 'id_perms': {'created': '2025-01-16T00:53:32.467628', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.467628', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13060121218333277490, 'uuid_mslong': 15196611020721768251}}, 'job_template_concurrency_level': 'device', 'job_template_description': '', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"source_ip": ' '{"$id": "/properties/source_ip", ' '"title": "Source (device loopback ' 'IP)", "type": "string", "default": ' '""}, "destination_ip": {"$id": ' '"/properties/destination_ip", ' '"title": "Destination (device ' 'loopback IP)", "type": "string", ' '"default": ""}, "vni": {"$id": ' '"/properties/vni", "title": "VNI", ' '"type": "integer", "default": ' '100}, "count": {"$id": ' '"/properties/count", "title": ' '"Packet count", "type": "integer", ' '"default": 5}}, "required": ' '["source_ip", "destination_ip", ' '"count", "vni"]}', 'job_template_input_ui_schema': '{"destination_ip": {"ui:help": ' '""}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show connectivity test ' 'report", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Each playbook\'s ' 'command_output for this specific ' 'command.", "properties": ' '{"config_output": {"type": ' '"string", "title": "Connectivity ' 'test report", "description": ' '"Display connectivity test ' 'report"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd2e53535-4fe8-473b-b53e-df0d764bfd32'}, 'oper': 'CREATE', 'request-id': 'req-5cd3db30-230b-4da2-b9c6-54acd9eff428', 'type': 'job_template', 'uuid': 'd2e53535-4fe8-473b-b53e-df0d764bfd32'} 01/16/2025 00:53:32.528 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-c416f71b-e186-409b-8306-e418594dc620', 'type': 'routing_instance', 'uuid': '56cbdf9e-b633-4514-a9e7-8dd4924b9d8b'} 01/16/2025 00:53:32.533 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_ops_info_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_ops_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"ops_type\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Operations commands\", \"type\": \"array\", \"minItems\": 1, \"items\": {\"$id\": \"/properties/interface_filters/items\", \"type\": \"object\", \"minProperties\": 1, \"additionalProperties\": false, \"properties\": {\"conditional\": {\"title\": \"Operation Command Type\", \"$ref\": \"#/definitions/sub_command\"}}}}}, \"definitions\": {\"sub_command\": {\"type\": \"object\", \"properties\": {\"sub_operation\": {\"title\": \"Choose a sub-operation\", \"type\": \"string\", \"enum\": [\"show chassis info\", \"show route info\", \"show bgp info\", \"show evpn info\", \"show lldp info\", \"show lacp info\", \"show vlan info\"], \"default\": \"show route info\"}}, \"required\": [\"sub_operation\"], \"dependencies\": {\"sub_operation\": {\"oneOf\": [{\"properties\": {\"sub_operation\": {\"enum\": [\"show chassis info\"]}, \"command_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis alarms\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show route info\"]}, \"command_detail\": {\"$id\": \"/properties/route_detail\", \"title\": \"Route detail\", \"type\": \"string\", \"enum\": [\"route summary\"], \"default\": \"route summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show bgp info\"]}, \"command_detail\": {\"$id\": \"/properties/bgp_detail\", \"title\": \"BGP detail\", \"type\": \"string\", \"enum\": [\"bgp summary\", \"bgp neighbor\", \"bgp group\"], \"default\": \"bgp summary\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show evpn info\"]}, \"command_detail\": {\"$id\": \"/properties/evpn_detail\", \"title\": \"EVPN detail\", \"type\": \"string\", \"enum\": [\"evpn ip-prefix-database\", \"evpn instance extensive\", \"evpn instance designated-forwarder\", \"evpn instance backup-forwarder\", \"evpn database state default-gateway\"], \"default\": \"evpn ip-prefix-database\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lldp info\"]}, \"command_detail\": {\"$id\": \"/properties/lldp_detail\", \"title\": \"LLDP detail\", \"type\": \"string\", \"enum\": [\"lldp neighbors\"], \"default\": \"lldp neighbors\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show lacp info\"]}, \"command_detail\": {\"$id\": \"/properties/lacp_detail\", \"title\": \"LACP detail\", \"type\": \"string\", \"enum\": [\"lacp interfaces extensive\", \"lacp statistics interfaces\"], \"default\": \"lacp interfaces extensive\"}}}, {\"properties\": {\"sub_operation\": {\"enum\": [\"show vlan info\"]}, \"command_detail\": {\"$id\": \"/properties/vlan_detail\", \"title\": \"VLAN detail\", \"type\": \"string\", \"enum\": [\"vlans\"], \"default\": \"vlans\"}}}]}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display operational information", "display_name": "Show operations information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.636 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'obj_dict': {'display_name': 'Show operations information', 'fq_name': ['default-global-system-config', 'show_ops_info_template'], 'id_perms': {'created': '2025-01-16T00:53:32.574642', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.574642', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13326884676963820150, 'uuid_mslong': 15935474076646721962}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'operational information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"ops_type": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Operations commands", ' '"type": "array", "minItems": 1, ' '"items": {"$id": ' '"/properties/interface_filters/items", ' '"type": "object", "minProperties": ' '1, "additionalProperties": false, ' '"properties": {"conditional": ' '{"title": "Operation Command ' 'Type", "$ref": ' '"#/definitions/sub_command"}}}}}, ' '"definitions": {"sub_command": ' '{"type": "object", "properties": ' '{"sub_operation": {"title": ' '"Choose a sub-operation", "type": ' '"string", "enum": ["show chassis ' 'info", "show route info", "show ' 'bgp info", "show evpn info", "show ' 'lldp info", "show lacp info", ' '"show vlan info"], "default": ' '"show route info"}}, "required": ' '["sub_operation"], "dependencies": ' '{"sub_operation": {"oneOf": ' '[{"properties": {"sub_operation": ' '{"enum": ["show chassis info"]}, ' '"command_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis alarms"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show route info"]}, ' '"command_detail": {"$id": ' '"/properties/route_detail", ' '"title": "Route detail", "type": ' '"string", "enum": ["route ' 'summary"], "default": "route ' 'summary"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'bgp info"]}, "command_detail": ' '{"$id": "/properties/bgp_detail", ' '"title": "BGP detail", "type": ' '"string", "enum": ["bgp summary", ' '"bgp neighbor", "bgp group"], ' '"default": "bgp summary"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show evpn info"]}, ' '"command_detail": {"$id": ' '"/properties/evpn_detail", ' '"title": "EVPN detail", "type": ' '"string", "enum": ["evpn ' 'ip-prefix-database", "evpn ' 'instance extensive", "evpn ' 'instance designated-forwarder", ' '"evpn instance backup-forwarder", ' '"evpn database state ' 'default-gateway"], "default": ' '"evpn ip-prefix-database"}}}, ' '{"properties": {"sub_operation": ' '{"enum": ["show lldp info"]}, ' '"command_detail": {"$id": ' '"/properties/lldp_detail", ' '"title": "LLDP detail", "type": ' '"string", "enum": ["lldp ' 'neighbors"], "default": "lldp ' 'neighbors"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'lacp info"]}, "command_detail": ' '{"$id": "/properties/lacp_detail", ' '"title": "LACP detail", "type": ' '"string", "enum": ["lacp ' 'interfaces extensive", "lacp ' 'statistics interfaces"], ' '"default": "lacp interfaces ' 'extensive"}}}, {"properties": ' '{"sub_operation": {"enum": ["show ' 'vlan info"]}, "command_detail": ' '{"$id": "/properties/vlan_detail", ' '"title": "VLAN detail", "type": ' '"string", "enum": ["vlans"], ' '"default": "vlans"}}}]}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dd262d3e-31f9-49aa-b8f2-9b013d066276'}, 'oper': 'CREATE', 'request-id': 'req-046e9348-3cbd-4271-a41d-c0a1ec6530e4', 'type': 'job_template', 'uuid': 'dd262d3e-31f9-49aa-b8f2-9b013d066276'} 01/16/2025 00:53:32.687 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-01-16T00:53:32.667763', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.667763', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10920068701887758477, 'uuid_mslong': 2241986773642069818}}, 'parent_type': 'virtual-network', 'parent_uuid': '0678c6bd-5bfd-4b8a-8d00-0b438b2f5966', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1f1d2317-920f-473a-978b-e0a09ae1808d'}, 'oper': 'CREATE', 'request-id': 'req-598be872-dd40-4b61-917e-6b003603677f', 'type': 'access_control_list', 'uuid': '1f1d2317-920f-473a-978b-e0a09ae1808d'} 01/16/2025 00:53:32.743 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-903d0dbe-ae60-4c1c-adb6-3d4a72f0e72e', 'type': 'access_control_list', 'uuid': '678961fb-8f1c-428c-a6de-ce9d5f8d71db'} 01/16/2025 00:53:32.754 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'check_multicast_template'], 'obj_dict': {'display_name': 'Check incoming multicast traffic', 'fq_name': ['default-global-system-config', 'check_multicast_template'], 'id_perms': {'created': '2025-01-16T00:53:32.691755', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.691755', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12814328586151297870, 'uuid_mslong': 18208676134702632518}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'Check multicast', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"warning_banner": ' '{"$id": ' '"/properties/warning_banner", ' '"title": "This GDO gathers ' 'multicast statistics from the ' 'whole fabric and it might take a ' 'few minutes to complete.", "type": ' '"object", "properties": ' '{"warning_banner_2": {"$id": ' '"/properties/warning_banner_2", ' '"title": "It is assumed that:", ' '"type": "object", "properties": ' '{"warning_banner_3": {"$id": ' '"/properties/warning_banner_3", ' '"title": "(1) the traffic is ' 'coming from outside of the fabric ' '(through device(s) with ' 'CRB-MCAST-Gateway role);", "type": ' '"object", "properties": ' '{"warning_banner_4": {"$id": ' '"/properties/warning_banner_4", ' '"title": "(2) the traffic is going ' 'to devices attached to server ' 'leaves (physical_router_role == ' '\'leaf\');", "type": "object", ' '"properties": {"warning_banner_5": ' '{"$id": ' '"/properties/warning_banner_5", ' '"title": "(3) PIM is enabled in ' 'the fabric.", "type": "object", ' '"properties": {}}}}}}}}}}, ' '"source": {"$id": ' '"/properties/source", "title": ' '"Source", "type": "string", ' '"default": ""}, "group": {"$id": ' '"/properties/group", "title": ' '"Group", "type": "string", ' '"default": ""}}, "required": ' '["source", "group"]}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Check multicast ' 'output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Device ' 'Configuration", "description": ' '"Display Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fcb23678-8715-4e46-b1d5-a3f4b4ae834e'}, 'oper': 'CREATE', 'request-id': 'req-022c99c0-dbef-4211-8c69-1aa4edc74c56', 'type': 'job_template', 'uuid': 'fcb23678-8715-4e46-b1d5-a3f4b4ae834e'} 01/16/2025 00:53:32.758 7f9844fcbcc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 874a7cfc-7a74-432b-bcfb-38918b5f414d object_type = access_control_list identifier_name = default-domain:default-project:__no_rule__:egress-access-control-list url = http://10.0.0.43:8082/access-control-list/874a7cfc-7a74-432b-bcfb-38918b5f414d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-schema remote_ip = 10.0.0.23 body = {"access-control-list": {"uuid": "874a7cfc-7a74-432b-bcfb-38918b5f414d", "access_control_list_entries": {"dynamic": null, "acl_rule": []}, "access_control_list_hash": -782339169199063927}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.779 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-b0c4f16c-bf3e-4106-88da-e34d34b2d502', 'type': 'access_control_list', 'uuid': '874a7cfc-7a74-432b-bcfb-38918b5f414d'} 01/16/2025 00:53:32.827 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'obj_dict': {'display_name': 'Existing Fabric Onboarding', 'fq_name': ['default-global-system-config', 'existing_fabric_onboard_template'], 'id_perms': {'created': '2025-01-16T00:53:32.812877', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.812877', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11925402096417478243, 'uuid_mslong': 13257707555579842134}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "fabric info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"required": ["fabric_fq_name", ' '"management_subnets", ' '"device_auth", "node_profiles"], ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"fabric_display_name": {"type": ' '"string"}, "fabric_cluster_id": ' '{"type": "integer"}, ' '"management_subnets": {"type": ' '"array", "items": {"type": ' '"object", "description": "List of ' 'the management network subnets for ' 'the fabric", ' '"additionalProperties": false, ' '"required": ["cidr"], ' '"properties": {"cidr": {"type": ' '"string", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}, ' '"gateway": {"type": "string", ' '"format": "ipv4"}}}}, ' '"loopback_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that fabric ' 'device loopback ips can be ' 'allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"overlay_loopback_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'fabric device overlay loopback ips ' 'can be allocated.", "pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_subnets": {"type": ' '"array", "items": {"type": ' '"string", "description": "List of ' 'the subnet prefixes that could be ' 'carved out for the p2p networks ' 'between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"pnf_servicechain_subnets": ' '{"type": "array", "items": ' '{"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for service ' 'chaining between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"fabric_asn_pool": {"type": ' '"array", "items": {"title": "eBGP ' 'ASN Pool for fabric underlay ' 'network", "type": "object", ' '"description": "List of the ASN ' 'pools that could be used to ' 'configure the eBGP peers for the ' 'IP fabric", "properties": ' '{"asn_min": {"type": "integer"}, ' '"asn_max": {"type": "integer"}}, ' '"required": ["asn_min", ' '"asn_max"]}}, "overlay_ibgp_asn": ' '{"type": "integer", "title": "iBGP ' 'ASN for Contrail overlay network", ' '"default": 64512}, "device_auth": ' '{"title": "Device Auth", "type": ' '"array", "items": {"type": ' '"object", "additionalProperties": ' 'false, "required": ["username", ' '"password"], "properties": ' '{"username": {"type": "string"}, ' '"password": {"type": "string"}}}}, ' '"node_profiles": {"type": "array", ' '"items": {"title": "Node profile", ' '"type": "object", "description": ' '"List of node profiles to be used ' 'by the fabric.", ' '"additionalProperties": false, ' '"properties": ' '{"node_profile_name": {"type": ' '"string"}, "serial_nums": {"type": ' '"array", "description": "Optional ' 'list of serial numbers of fabric ' 'devices that we want to associate ' 'with this node profile.", "items": ' '{"type": "string"}}}, "required": ' '["node_profile_name"]}}, ' '"interface_filters": {"type": ' '"array", "items": {"type": ' '"object", "maxProperties": 2, ' '"additionalProperties": false, ' '"properties": {"op": {"enum": ' '["regex"]}, "expr": {"type": ' '"string"}}, "title": "filter ' 'object", "description": "filter ' 'object having op and expr fields", ' '"default": {}, "examples": [{"op": ' '"regex", "expr": "^ge-"}, {"op": ' '"regex", "expr": "^xe"}]}}, ' '"manage_underlay": {"title": ' '"Manage underlay networking", ' '"type": "boolean", "description": ' '"Set to true if need to configure ' 'underlay networking", "default": ' 'false}, "import_configured": ' '{"type": "boolean", "default": ' 'false, "description": "Not ' 'importing configured interfaces by ' 'default. Set this option to true ' 'if configured interfaces need to ' 'be imported as part of ' 'onboarding."}, "device_count": ' '{"title": "Number of fabric ' 'devices", "type": "integer", ' '"description": "Total number of ' 'devices in the fabric that needs ' 'to be zero-touch provisioned"}, ' '"enterprise_style": {"type": ' '"boolean", "default": true, ' '"description": "True if enterprise ' 'style, false if sp-style ' 'configuration"}, ' '"disable_vlan_vn_uniqueness_check": ' '{"type": "boolean", "default": ' 'false, "description": "True if ' 'vlan-vn uniqueness validation ' 'checks needs to be disabled, false ' 'if enable all complex ' 'validations"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/existing_fabric_onboard.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_device.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 10, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_role.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 5, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 40, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/device_import.yml', 'refresh_token': False, 'sequence_no': 4, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/topology_discovery.yml', 'refresh_token': False, 'sequence_no': 5, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b7fcd6c7-8a59-4e56-a57f-8a05f0a99663'}, 'oper': 'CREATE', 'request-id': 'req-acd0da0c-a287-4067-a2d0-41471aff6202', 'type': 'job_template', 'uuid': 'b7fcd6c7-8a59-4e56-a57f-8a05f0a99663'} 01/16/2025 00:53:32.846 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:vcenter_import_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "vcenter_import_template"], "parent_type": "global-system-config", "job_template_type": "executable", "job_template_concurrency_level": "fabric", "job_template_executables": {"executable_info": [{"executable_path": "/opt/contrail/utils/vcenter-import", "executable_args": "", "job_completion_weightage": 100}]}, "job_template_input_schema": "{\"title\": \"vCenter Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"contrail_command\": {\"$id\": \"/properties/contrail_command\", \"description\": \"The Contrail Command details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/contrail_command/username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/contrail_command/password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/contrail_command/host\", \"description\": \"The Contrail Command IP and/or port\", \"type\": \"string\"}}}, \"vcenter\": {\"$id\": \"/properties/vcenter\", \"description\": \"vCenter details\", \"type\": \"object\", \"properties\": {\"username\": {\"$id\": \"/properties/vcenter/username\", \"description\": \"Username of vCenter Server\", \"type\": \"string\"}, \"password\": {\"$id\": \"/properties/vcenter/password\", \"description\": \"Password of vCenter Server\", \"type\": \"string\"}, \"datacenter\": {\"$id\": \"/properties/vcenter/datacenter\", \"description\": \"vCenter DataCenter name to Import ESXi Hosts\", \"type\": \"string\"}, \"host\": {\"$id\": \"/properties/vcenter/host\", \"description\": \"vCenter Hostname/IP-Address including port\", \"type\": \"string\"}}}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "VCenter Import", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:32.882 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'obj_dict': {'display_name': 'VCenter Import', 'fq_name': ['default-global-system-config', 'vcenter_import_template'], 'id_perms': {'created': '2025-01-16T00:53:32.870063', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.870063', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12265424756011151936, 'uuid_mslong': 12254723771992785507}}, 'job_template_concurrency_level': 'fabric', 'job_template_executables': {'executable_info': [{'executable_args': '', 'executable_path': '/opt/contrail/utils/vcenter-import', 'job_completion_weightage': 100}]}, 'job_template_input_schema': '{"title": "vCenter Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"contrail_command": {"$id": ' '"/properties/contrail_command", ' '"description": "The Contrail ' 'Command details", "type": ' '"object", "properties": ' '{"username": {"$id": ' '"/properties/contrail_command/username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "password": {"$id": ' '"/properties/contrail_command/password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, "host": {"$id": ' '"/properties/contrail_command/host", ' '"description": "The Contrail ' 'Command IP and/or port", "type": ' '"string"}}}, "vcenter": {"$id": ' '"/properties/vcenter", ' '"description": "vCenter details", ' '"type": "object", "properties": ' '{"username": {"$id": ' '"/properties/vcenter/username", ' '"description": "Username of ' 'vCenter Server", "type": ' '"string"}, "password": {"$id": ' '"/properties/vcenter/password", ' '"description": "Password of ' 'vCenter Server", "type": ' '"string"}, "datacenter": {"$id": ' '"/properties/vcenter/datacenter", ' '"description": "vCenter DataCenter ' 'name to Import ESXi Hosts", ' '"type": "string"}, "host": {"$id": ' '"/properties/vcenter/host", ' '"description": "vCenter ' 'Hostname/IP-Address including ' 'port", "type": "string"}}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_type': 'executable', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'aa118657-a22a-4263-aa37-8ad4a153b240'}, 'oper': 'CREATE', 'request-id': 'req-323f2a90-832c-47a9-9597-f6c41282b9a2', 'type': 'job_template', 'uuid': 'aa118657-a22a-4263-aa37-8ad4a153b240'} 01/16/2025 00:53:32.944 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'discover_server_template'], 'obj_dict': {'display_name': 'Server Discovery', 'fq_name': ['default-global-system-config', 'discover_server_template'], 'id_perms': {'created': '2025-01-16T00:53:32.935012', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.935012', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10942682131414938258, 'uuid_mslong': 12904018766687652954}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server info", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, "ipmi": ' '{"$id": "/properties/ipmi", ' '"type": "object", "required": ' '["ipmi_subnet_list", ' '"ipmi_credentials"], "properties": ' '{"ipmi_subnet_list": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_subnet_list/items", ' '"type": "string", "description": ' '"List of the subnet prefixes that ' 'could be carved out for the p2p ' 'networks between fabric devices.", ' '"pattern": ' '"^([0-9]{1,3}\\\\.){3}[0-9]{1,3}(/([0-9]|[1-2][0-9]|3[0-2]))?$"}}, ' '"ipmi_credentials": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"description": "The IPMI ' 'user:password credentials", ' '"type": "string"}}, ' '"ipmi_port_ranges": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges", ' '"type": "array", "items": {"$id": ' '"/properties/ipmi/properties/ipmi_credentials/items", ' '"type": "object", "required": ' '["port_range_start", ' '"port_range_end"], "properties": ' '{"port_range_start": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_start", ' '"description": "Start of IPMI Port ' 'Range", "type": "integer"}, ' '"port_range_end": {"$id": ' '"/properties/ipmi/properties/ipmi_port_ranges/items/port_range_end", ' '"description": "End of IPMI Port ' 'Range", "type": "integer"}}}}}}, ' '"ironic": {"$id": ' '"/properties/ironic", "type": ' '"object", "required": ["auth_url", ' '"username", "password"], ' '"properties": {"auth_url": {"$id": ' '"/properties/ironic/properties/auth_url", ' '"description": "The Ironic Auth ' 'URL", "type": "string"}, ' '"username": {"$id": ' '"/properties/ironic/properties/username", ' '"description": "The Ironic Auth ' 'username", "type": "string"}, ' '"password": {"$id": ' '"/properties/ironic/properties/password", ' '"description": "The Ironic Auth ' 'password", "type": "string"}, ' '"introspection_flag": {"$id": ' '"/properties/ironic/properties/introspection_flag", ' '"description": "Flag to determine ' 'if introspection is needed", ' '"type": "boolean", "default": ' 'true}}}, "cc_username": {"$id": ' '"/properties/cc_username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/discover_server.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b31448b3-2b64-4c5a-97dc-376bf5007292'}, 'oper': 'CREATE', 'request-id': 'req-13c68e81-adab-41c0-be14-1f155a75b9fd', 'type': 'job_template', 'uuid': 'b31448b3-2b64-4c5a-97dc-376bf5007292'} 01/16/2025 00:53:33.005 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'server_import_template'], 'obj_dict': {'display_name': 'Server Import', 'fq_name': ['default-global-system-config', 'server_import_template'], 'id_perms': {'created': '2025-01-16T00:53:32.994772', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:32.994772', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10194664708628451940, 'uuid_mslong': 5730895202779221122}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "server import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command IP", "type": "string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/server_import.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4f883ad2-c6a5-4c82-8d7a-b989f2029264'}, 'oper': 'CREATE', 'request-id': 'req-a3bbf340-bb8b-4ec6-b7fa-7cad471839ee', 'type': 'job_template', 'uuid': '4f883ad2-c6a5-4c82-8d7a-b989f2029264'} 01/16/2025 00:53:33.027 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:node_profile_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "node_profile_template"], "parent_type": "global-system-config", "job_template_concurrency_level": "fabric", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/node_profile.yml", "multi_device_playbook": false, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"title\": \"Node Profile Import\", \"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"fabric_fq_name\": {\"type\": \"array\", \"items\": {\"type\": \"string\"}}, \"encoded_file\": {\"$id\": \"/properties/encoded_file\", \"description\": \"The Encoded File to Import\", \"type\": \"string\"}, \"file_format\": {\"$id\": \"/properties/file_format\", \"type\": \"string\", \"description\": \"The format of the encoded input file\", \"enum\": [\"yaml\", \"json\", \"YAML\", \"JSON\"]}, \"cc_username\": {\"$id\": \"/properties/cc_username\", \"description\": \"The Contrail Command Login Username\", \"type\": \"string\"}, \"cc_password\": {\"$id\": \"/properties/cc_password\", \"description\": \"The Contrail Command Login Password\", \"type\": \"string\"}, \"contrail_command_host\": {\"$id\": \"/properties/contrail_command_host\", \"description\": \"The Contrail Command Hostname/IP\", \"type\": \"string\"}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Generic Job Output\", \"type\": \"object\", \"properties\": {\"status\": {\"type\": \"string\", \"enum\": [\"Success\", \"Failure\", \"Timeout\"], \"description\": \"Result status of the job\"}, \"message\": {\"type\": \"string\", \"description\": \"Should capture a summarized error message in case of Failures.\"}, \"results\": {\"type\": \"object\", \"description\": \"JSON object holding the job specific output details\"}}, \"required\": [\"status\"]}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "display_name": "Node Profile", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:33.113 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'node_profile_template'], 'obj_dict': {'display_name': 'Node Profile', 'fq_name': ['default-global-system-config', 'node_profile_template'], 'id_perms': {'created': '2025-01-16T00:53:33.051629', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.051629', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11921583408048393834, 'uuid_mslong': 9771004162247510824}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "Node Profile Import", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_fq_name": ' '{"type": "array", "items": ' '{"type": "string"}}, ' '"encoded_file": {"$id": ' '"/properties/encoded_file", ' '"description": "The Encoded File ' 'to Import", "type": "string"}, ' '"file_format": {"$id": ' '"/properties/file_format", "type": ' '"string", "description": "The ' 'format of the encoded input file", ' '"enum": ["yaml", "json", "YAML", ' '"JSON"]}, "cc_username": {"$id": ' '"/properties/cc_username", ' '"description": "The Contrail ' 'Command Login Username", "type": ' '"string"}, "cc_password": {"$id": ' '"/properties/cc_password", ' '"description": "The Contrail ' 'Command Login Password", "type": ' '"string"}, ' '"contrail_command_host": {"$id": ' '"/properties/contrail_command_host", ' '"description": "The Contrail ' 'Command Hostname/IP", "type": ' '"string"}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/node_profile.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '87999484-3da0-4b28-a571-f8f244ea4e6a'}, 'oper': 'CREATE', 'request-id': 'req-976b2923-a05a-4dff-af32-ac8345c3c785', 'type': 'job_template', 'uuid': '87999484-3da0-4b28-a571-f8f244ea4e6a'} 01/16/2025 00:53:33.213 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'obj_dict': {'display_name': 'Show mac mobility', 'fq_name': ['default-global-system-config', 'show_mac_mob_template'], 'id_perms': {'created': '2025-01-16T00:53:33.160719', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.160719', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9508962911869588656, 'uuid_mslong': 4778141299569017166}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display MAC ' 'address move or mobility', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"mac_details": ' '{"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "MAC Details", "type": ' '"object", "properties": ' '{"mac_address": {"$id": ' '"/properties/mac_address", ' '"title": "Mac Address", "pattern": ' '"^\\\\s*([A-Fa-f0-9]{2}(:{1}[A-Fa-f0-9]{2}){5})\\\\s*$", ' '"type": "string"}}, "required": ' '["mac_address"]}}}', 'job_template_input_ui_schema': '{"mac_details": {"mac_address": ' '{"ui:help": "Enter a 48 bit MAC ' 'address in colon separated ' 'format; for example, ' '00:00:0A:BB:28:FC", ' '"ui:placeholder": "Enter MAC ' 'address"}}}', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show MAC mobility ' 'Output", "type": "object", ' '"properties": {"results": ' '{"type": "array", "description": ' '"Array holding the specific ' 'output details in case of ' 'success. Each object of the array ' 'would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "MAC History", ' '"description": "Display Device ' 'Configuration output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '424f5e32-3f6f-414e-83f6-9f634059d4b0'}, 'oper': 'CREATE', 'request-id': 'req-7138c359-b123-4a91-963b-5ff3291704f9', 'type': 'job_template', 'uuid': '424f5e32-3f6f-414e-83f6-9f634059d4b0'} 01/16/2025 00:53:33.320 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-36baf0b1-64e4-4a80-85e7-bc0e0525059d', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:33.345 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rma_activate_template'], 'obj_dict': {'display_name': 'RMA Activation', 'fq_name': ['default-global-system-config', 'rma_activate_template'], 'id_perms': {'created': '2025-01-16T00:53:33.285738', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.285738', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13446615845774790393, 'uuid_mslong': 7161699459298377888}}, 'job_template_concurrency_level': 'fabric', 'job_template_input_schema': '{"title": "RMA activate", ' '"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"fabric_uuid": ' '{"type": "string", "description": ' '"Fabric UUID"}, "rma_devices": ' '{"type": "array", "items": ' '{"title": "RMA Devices", "type": ' '"object", "description": "List of ' 'devices and corresponding serial ' 'numbers to RMA", ' '"additionalProperties": false, ' '"properties": {"device_uuid": ' '{"type": "string", "format": ' '"uuid"}, "serial_number": {"type": ' '"string"}}, "required": ' '["device_uuid", ' '"serial_number"]}}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/rma_activate.yml', 'refresh_token': False, 'sequence_no': 0, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 15, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/assign_static_device_ip.yml', 'refresh_token': False, 'sequence_no': 1, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 50, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/ztp_select_image.yml', 'refresh_token': False, 'sequence_no': 2, 'vendor': 'Juniper'}, {'device_family': '', 'job_completion_weightage': 20, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': 3, 'vendor': 'Juniper'}]}, 'job_template_recovery_playbooks': {'playbook_info': [{'device_family': None, 'job_completion_weightage': 100, 'multi_device_playbook': False, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/update_dhcp_config.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': None}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '636377b6-c396-40a0-ba9b-f9de568b8ef9'}, 'oper': 'CREATE', 'request-id': 'req-5100638b-6e10-4a7c-a9f8-09c5001e8c15', 'type': 'job_template', 'uuid': '636377b6-c396-40a0-ba9b-f9de568b8ef9'} 01/16/2025 00:53:33.366 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = job_template identifier_name = default-global-system-config:show_chassis_info_template url = http://10.0.0.43:8082/job-templates operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"job-template": {"uuid": null, "fq_name": ["default-global-system-config", "show_chassis_info_template"], "parent_type": "global-system-config", "job_template_type": "device_operation", "job_template_concurrency_level": "device", "job_template_playbooks": {"playbook_info": [{"playbook_uri": "./opt/contrail/fabric_ansible_playbooks/operational_command.yml", "multi_device_playbook": true, "refresh_token": false, "vendor": "Juniper", "device_family": "", "job_completion_weightage": 100, "sequence_no": null}]}, "job_template_input_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"type\": \"object\", \"additionalProperties\": false, \"properties\": {\"chassis\": {\"src\": \"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies\", \"title\": \"Chassis information\", \"type\": \"object\", \"properties\": {\"chassis_detail\": {\"$id\": \"/properties/chassis_detail\", \"title\": \"Chassis detail\", \"type\": \"string\", \"enum\": [\"chassis alarms\", \"chassis environment\", \"chassis environment cb\", \"chassis environment fpc\", \"chassis environment pem\", \"chassis environment routing-engine\", \"chassis fpc detail\", \"chassis fan\", \"chassis firmware\", \"chassis mac-addresses\", \"chassis routing-engine\", \"chassis power\", \"chassis hardware\", \"chassis hardware detail\", \"chassis hardware clei-models\", \"chassis temperature-thresholds\"], \"default\": \"chassis hardware\"}}, \"required\": [\"chassis_detail\"]}}}", "job_template_output_schema": "{\"$schema\": \"http://json-schema.org/draft-06/schema#\", \"title\": \"Show chassis Output\", \"type\": \"object\", \"properties\": {\"results\": {\"type\": \"array\", \"description\": \"Array holding the specific output details in case of success. Each object of the array would be command_output and device name pair.\", \"items\": {\"type\": \"object\", \"properties\": {\"device_name\": {\"type\": \"string\", \"title\": \"Device Name\", \"description\": \"name of the device for which results are displayed\"}, \"command_output\": {\"type\": \"object\", \"title\": \"Each playbook's command_output for this specific command.\", \"description\": \"Results of the show interfaces command executed on the device. The jinja template matching this command, vendor and family would give output of the below format. This command_output translates to device_op_results in the PR uve\", \"properties\": {\"config_output\": {\"type\": \"string\", \"title\": \"Chassis info\", \"description\": \"Display Device Configuration output\"}}}}}}}}", "job_template_input_ui_schema": "null", "job_template_output_ui_schema": "null", "job_template_description": "This command is used to display chassis information", "display_name": "Show chassis information", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:33.410 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'obj_dict': {'display_name': 'Show chassis information', 'fq_name': ['default-global-system-config', 'show_chassis_info_template'], 'id_perms': {'created': '2025-01-16T00:53:33.392855', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.392855', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12328397914833387610, 'uuid_mslong': 5790953493391492261}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to display ' 'chassis information', 'job_template_input_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", ' '"additionalProperties": false, ' '"properties": {"chassis": {"src": ' '"https://spacetelescope.github.io/understanding-json-schema/reference/object.html#dependencies", ' '"title": "Chassis information", ' '"type": "object", "properties": ' '{"chassis_detail": {"$id": ' '"/properties/chassis_detail", ' '"title": "Chassis detail", "type": ' '"string", "enum": ["chassis ' 'alarms", "chassis environment", ' '"chassis environment cb", "chassis ' 'environment fpc", "chassis ' 'environment pem", "chassis ' 'environment routing-engine", ' '"chassis fpc detail", "chassis ' 'fan", "chassis firmware", "chassis ' 'mac-addresses", "chassis ' 'routing-engine", "chassis power", ' '"chassis hardware", "chassis ' 'hardware detail", "chassis ' 'hardware clei-models", "chassis ' 'temperature-thresholds"], ' '"default": "chassis hardware"}}, ' '"required": ["chassis_detail"]}}}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Show chassis Output", ' '"type": "object", "properties": ' '{"results": {"type": "array", ' '"description": "Array holding the ' 'specific output details in case ' 'of success. Each object of the ' 'array would be command_output and ' 'device name pair.", "items": ' '{"type": "object", "properties": ' '{"device_name": {"type": ' '"string", "title": "Device Name", ' '"description": "name of the ' 'device for which results are ' 'displayed"}, "command_output": ' '{"type": "object", "title": "Each ' "playbook's command_output for " 'this specific command.", ' '"description": "Results of the ' 'show interfaces command executed ' 'on the device. The jinja template ' 'matching this command, vendor and ' 'family would give output of the ' 'below format. This command_output ' 'translates to device_op_results ' 'in the PR uve", "properties": ' '{"config_output": {"type": ' '"string", "title": "Chassis ' 'info", "description": "Display ' 'Device Configuration ' 'output"}}}}}}}}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/operational_command.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'device_operation', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '505d9985-3c68-44a5-ab17-4495bb4f805a'}, 'oper': 'CREATE', 'request-id': 'req-2968e81e-a50b-4b6f-a997-4b4e554cc270', 'type': 'job_template', 'uuid': '505d9985-3c68-44a5-ab17-4495bb4f805a'} 01/16/2025 00:53:33.543 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'obj_dict': {'display_name': 'Fetch hardware chassis information', 'fq_name': ['default-global-system-config', 'hardware_inventory_template'], 'id_perms': {'created': '2025-01-16T00:53:33.479399', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.479399', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10562693943629630584, 'uuid_mslong': 7125146005036419031}}, 'job_template_concurrency_level': 'device', 'job_template_description': 'This command is used to fetch ' 'hardware inventory information from ' 'the device', 'job_template_input_schema': '{"title": "Hardware Inventory ' 'Information", "$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"type": "object", "minProperties": ' '1}', 'job_template_input_ui_schema': 'null', 'job_template_output_schema': '{"$schema": ' '"http://json-schema.org/draft-06/schema#", ' '"title": "Generic Job Output", ' '"type": "object", "properties": ' '{"status": {"type": "string", ' '"enum": ["Success", "Failure", ' '"Timeout"], "description": ' '"Result status of the job"}, ' '"message": {"type": "string", ' '"description": "Should capture a ' 'summarized error message in case ' 'of Failures."}, "results": ' '{"type": "object", "description": ' '"JSON object holding the job ' 'specific output details"}}, ' '"required": ["status"]}', 'job_template_output_ui_schema': 'null', 'job_template_playbooks': {'playbook_info': [{'device_family': '', 'job_completion_weightage': 100, 'multi_device_playbook': True, 'playbook_uri': './opt/contrail/fabric_ansible_playbooks/hardware_inventory.yml', 'refresh_token': False, 'sequence_no': None, 'vendor': 'Juniper'}]}, 'job_template_type': 'workflow', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '62e19a8a-7afd-47d7-9296-3a2d9d36cc78'}, 'oper': 'CREATE', 'request-id': 'req-17fcc038-54bc-4aa3-9485-2694a1c696e2', 'type': 'job_template', 'uuid': '62e19a8a-7afd-47d7-9296-3a2d9d36cc78'} 01/16/2025 00:53:33.629 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'config_property'], 'obj_dict': {'display_name': 'Config Property', 'fq_name': ['default-global-system-config', 'config_property'], 'id_perms': {'created': '2025-01-16T00:53:33.611609', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.611609', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11703113866730652265, 'uuid_mslong': 2108853121159283018}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'properties': {'key_value_pair': [{'key': 'junos_commit_timeout', 'value': '600'}, {'key': 'total_retry_timeout', 'value': '600'}, {'key': 'device_command_timeout', 'value': '600'}, {'key': 'ztp_timeout', 'value': '570'}]}, 'uuid': '1d4426bd-922c-414a-a269-d00e586dc269'}, 'oper': 'CREATE', 'request-id': 'req-ac04efec-f727-43a8-b8ad-27ca793ece23', 'type': 'config_properties', 'uuid': '1d4426bd-922c-414a-a269-d00e586dc269'} 01/16/2025 00:53:33.648 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-management-ip url = http://10.0.0.43:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-management-ip"], "tag_type_name": "label", "tag_value": "fabric-management-ip", "tag_predefined": true, "name": "label=fabric-management-ip", "display_name": "label=fabric-management-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:33.734 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-management-ip'], 'obj_dict': {'display_name': 'label=fabric-management-ip', 'fq_name': ['label=fabric-management-ip'], 'id_perms': {'created': '2025-01-16T00:53:33.703688', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.703688', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12704967891395030789, 'uuid_mslong': 16039842373536075013}}, 'name': 'label=fabric-management-ip', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000000', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-management-ip', 'uuid': 'de98f7a7-efe0-4d05-b051-1cfbc1582f05'}, 'oper': 'CREATE', 'request-id': 'req-7f1c9a9d-754d-46ac-b684-bcbea6d03ee0', 'type': 'tag', 'uuid': 'de98f7a7-efe0-4d05-b051-1cfbc1582f05'} 01/16/2025 00:53:33.735 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:33.735 7f9844f3af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.735 7f9844f3af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-management-ip elements = { display_name : "label=fabric-management-ip"fq_name : ["label=fabric-management-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16039842373536075013, "uuid_lslong": 12704967891395030789}, "enable": true, "created": "2025-01-16T00:53:33.703688", "last_modified": "2025-01-16T00:53:33.703688", "description": null, "user_visible": true, "creator": null}name : "label=fabric-management-ip"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000000"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-management-ip"uuid : "de98f7a7-efe0-4d05-b051-1cfbc1582f05" } deleted = False >> 01/16/2025 00:53:33.735 7f9844f3af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.814 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-loopback-ip', 'fq_name': ['label=fabric-loopback-ip'], 'id_perms': {'created': '2025-01-16T00:53:33.787672', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.787672', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9421516492056045128, 'uuid_mslong': 16283712316167112619}}, 'name': 'label=fabric-loopback-ip', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000001', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-loopback-ip', 'uuid': 'e1fb5e13-a5cb-47ab-82bf-f3550a7c2648'}, 'oper': 'CREATE', 'request-id': 'req-828ff8ad-5724-448c-a2ab-fa3394ff8015', 'type': 'tag', 'uuid': 'e1fb5e13-a5cb-47ab-82bf-f3550a7c2648'} 01/16/2025 00:53:33.814 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:33.815 7f9845004978 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.815 7f9845004978 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-loopback-ip elements = { display_name : "label=fabric-loopback-ip"fq_name : ["label=fabric-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16283712316167112619, "uuid_lslong": 9421516492056045128}, "enable": true, "created": "2025-01-16T00:53:33.787672", "last_modified": "2025-01-16T00:53:33.787672", "description": null, "user_visible": true, "creator": null}name : "label=fabric-loopback-ip"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000001"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-loopback-ip"uuid : "e1fb5e13-a5cb-47ab-82bf-f3550a7c2648" } deleted = False >> 01/16/2025 00:53:33.815 7f9845004978 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.895 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-overlay-loopback-ip'], 'obj_dict': {'display_name': 'label=fabric-overlay-loopback-ip', 'fq_name': ['label=fabric-overlay-loopback-ip'], 'id_perms': {'created': '2025-01-16T00:53:33.869495', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.869495', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10723487828782933434, 'uuid_mslong': 1212807673573884181}}, 'name': 'label=fabric-overlay-loopback-ip', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000002', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-overlay-loopback-ip', 'uuid': '10d4c227-443d-4115-94d1-7b5d63d4e5ba'}, 'oper': 'CREATE', 'request-id': 'req-ecd01c25-f2cd-47a5-833d-6d6899cac7bd', 'type': 'tag', 'uuid': '10d4c227-443d-4115-94d1-7b5d63d4e5ba'} 01/16/2025 00:53:33.895 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:33.896 7f9844f3ae10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.896 7f9844f3ae10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-overlay-loopback-ip elements = { display_name : "label=fabric-overlay-loopback-ip"fq_name : ["label=fabric-overlay-loopback-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 1212807673573884181, "uuid_lslong": 10723487828782933434}, "enable": true, "created": "2025-01-16T00:53:33.869495", "last_modified": "2025-01-16T00:53:33.869495", "description": null, "user_visible": true, "creator": null}name : "label=fabric-overlay-loopback-ip"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000002"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-overlay-loopback-ip"uuid : "10d4c227-443d-4115-94d1-7b5d63d4e5ba" } deleted = False >> 01/16/2025 00:53:33.896 7f9844f3ae10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.915 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-peer-ip url = http://10.0.0.43:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-peer-ip"], "tag_type_name": "label", "tag_value": "fabric-peer-ip", "tag_predefined": true, "name": "label=fabric-peer-ip", "display_name": "label=fabric-peer-ip", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:33.986 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-peer-ip'], 'obj_dict': {'display_name': 'label=fabric-peer-ip', 'fq_name': ['label=fabric-peer-ip'], 'id_perms': {'created': '2025-01-16T00:53:33.961206', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:33.961206', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13719912852377413021, 'uuid_mslong': 10084499966835248827}}, 'name': 'label=fabric-peer-ip', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000003', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-peer-ip', 'uuid': '8bf3574a-34a7-4ebb-be66-ec0c4b45a59d'}, 'oper': 'CREATE', 'request-id': 'req-12886e45-25c4-48a7-b71e-5b97022207ea', 'type': 'tag', 'uuid': '8bf3574a-34a7-4ebb-be66-ec0c4b45a59d'} 01/16/2025 00:53:33.987 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:33.987 7f9844f252e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:33.987 7f9844f252e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-peer-ip elements = { display_name : "label=fabric-peer-ip"fq_name : ["label=fabric-peer-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 10084499966835248827, "uuid_lslong": 13719912852377413021}, "enable": true, "created": "2025-01-16T00:53:33.961206", "last_modified": "2025-01-16T00:53:33.961206", "description": null, "user_visible": true, "creator": null}name : "label=fabric-peer-ip"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000003"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-peer-ip"uuid : "8bf3574a-34a7-4ebb-be66-ec0c4b45a59d" } deleted = False >> 01/16/2025 00:53:33.987 7f9844f252e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.080 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-pnf-servicechain-ip'], 'obj_dict': {'display_name': 'label=fabric-pnf-servicechain-ip', 'fq_name': ['label=fabric-pnf-servicechain-ip'], 'id_perms': {'created': '2025-01-16T00:53:34.047069', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.047069', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13775797043998954438, 'uuid_mslong': 4350751014462245266}}, 'name': 'label=fabric-pnf-servicechain-ip', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000004', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-pnf-servicechain-ip', 'uuid': '3c60f8ff-1331-4992-bf2d-766c996f13c6'}, 'oper': 'CREATE', 'request-id': 'req-4e8516ce-8cae-469b-9c4a-a84b25f4ced2', 'type': 'tag', 'uuid': '3c60f8ff-1331-4992-bf2d-766c996f13c6'} 01/16/2025 00:53:34.081 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:34.082 7f9846ad5c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.085 7f9846ad5c18 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-pnf-servicechain-ip elements = { display_name : "label=fabric-pnf-servicechain-ip"fq_name : ["label=fabric-pnf-servicechain-ip"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4350751014462245266, "uuid_lslong": 13775797043998954438}, "enable": true, "created": "2025-01-16T00:53:34.047069", "last_modified": "2025-01-16T00:53:34.047069", "description": null, "user_visible": true, "creator": null}name : "label=fabric-pnf-servicechain-ip"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000004"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-pnf-servicechain-ip"uuid : "3c60f8ff-1331-4992-bf2d-766c996f13c6" } deleted = False >> 01/16/2025 00:53:34.085 7f9846ad5c18 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.173 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig has a list of elements - it should be a dict. Controllers have inconsistency in their data.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-elements-inconsistency"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.207 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-as-number'], 'obj_dict': {'display_name': 'label=fabric-as-number', 'fq_name': ['label=fabric-as-number'], 'id_perms': {'created': '2025-01-16T00:53:34.170401', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.170401', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12224289670712716606, 'uuid_mslong': 8987102866722341928}}, 'name': 'label=fabric-as-number', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000005', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-as-number', 'uuid': '7cb89a71-0ae1-4428-a9a5-66b03e4eed3e'}, 'oper': 'CREATE', 'request-id': 'req-1a310cc0-e4a8-44ae-bb54-d5951e278e90', 'type': 'tag', 'uuid': '7cb89a71-0ae1-4428-a9a5-66b03e4eed3e'} 01/16/2025 00:53:34.208 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:34.209 7f9844f732e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.209 7f9844f732e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-as-number elements = { display_name : "label=fabric-as-number"fq_name : ["label=fabric-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 8987102866722341928, "uuid_lslong": 12224289670712716606}, "enable": true, "created": "2025-01-16T00:53:34.170401", "last_modified": "2025-01-16T00:53:34.170401", "description": null, "user_visible": true, "creator": null}name : "label=fabric-as-number"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000005"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-as-number"uuid : "7cb89a71-0ae1-4428-a9a5-66b03e4eed3e" } deleted = False >> 01/16/2025 00:53:34.209 7f9844f732e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.230 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = tag identifier_name = label=fabric-ebgp-as-number url = http://10.0.0.43:8082/tags operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"tag": {"uuid": null, "fq_name": ["label=fabric-ebgp-as-number"], "tag_type_name": "label", "tag_value": "fabric-ebgp-as-number", "tag_predefined": true, "name": "label=fabric-ebgp-as-number", "display_name": "label=fabric-ebgp-as-number", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.253 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-01-16T00:53:34.229439', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-01-16T00:53:34.229439', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13726809607473674700, 'uuid_mslong': 1172253581965215329}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1044ae6c-03b7-4661-be7f-6c9c38e339cc', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-eaa35cc9-8378-4cb7-a931-4a1199b3e7f5', 'type': 'alarm', 'uuid': '1044ae6c-03b7-4661-be7f-6c9c38e339cc'} 01/16/2025 00:53:34.273 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Compute Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-compute"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.317 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['label=fabric-ebgp-as-number'], 'obj_dict': {'display_name': 'label=fabric-ebgp-as-number', 'fq_name': ['label=fabric-ebgp-as-number'], 'id_perms': {'created': '2025-01-16T00:53:34.283079', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.283079', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9497192841814919658, 'uuid_mslong': 3147960200739376307}}, 'name': 'label=fabric-ebgp-as-number', 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'tag_id': '0x00000006', 'tag_predefined': True, 'tag_type_name': 'label', 'tag_type_refs': [{'to': ['label'], 'uuid': 'a05bed45-cff4-4436-a118-13479c9dd9db'}], 'tag_value': 'fabric-ebgp-as-number', 'uuid': '2bafcd1f-bc23-4cb3-83cc-ce9243c2c9ea'}, 'oper': 'CREATE', 'request-id': 'req-d71bca2a-e2a5-4945-a87f-4af949891248', 'type': 'tag', 'uuid': '2bafcd1f-bc23-4cb3-83cc-ce9243c2c9ea'} 01/16/2025 00:53:34.318 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:53:34.318 7f9844f090f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.319 7f9844f090f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = label=fabric-ebgp-as-number elements = { display_name : "label=fabric-ebgp-as-number"fq_name : ["label=fabric-ebgp-as-number"]id_perms : {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3147960200739376307, "uuid_lslong": 9497192841814919658}, "enable": true, "created": "2025-01-16T00:53:34.283079", "last_modified": "2025-01-16T00:53:34.283079", "description": null, "user_visible": true, "creator": null}name : "label=fabric-ebgp-as-number"perms2 : {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}tag_id : "0x00000006"tag_predefined : truetag_type_name : "label"tag_type_refs : [{"uuid": "a05bed45-cff4-4436-a118-13479c9dd9db", "to": ["label"]}]tag_value : "fabric-ebgp-as-number"uuid : "2bafcd1f-bc23-4cb3-83cc-ce9243c2c9ea" } deleted = False >> 01/16/2025 00:53:34.319 7f9844f090f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:34.339 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-01-16T00:53:34.302071', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-01-16T00:53:34.302071', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9980150621035541049, 'uuid_mslong': 5543755781113266476}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4cef6082-c6c6-412c-8a80-9e1cdbb7b239', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e7700895-e428-48b7-9361-77bfbeb8e089', 'type': 'alarm', 'uuid': '4cef6082-c6c6-412c-8a80-9e1cdbb7b239'} 01/16/2025 00:53:34.368 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-688817a2-2dfe-4174-abda-dc2798125611', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:53:34.387 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Control Node IP Address mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-address-mismatch-control"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.418 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afi', 'fq_name': ['juniper-qfx5100-48sh-afi'], 'id_perms': {'created': '2025-01-16T00:53:34.404282', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.404282', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10275984762369732097, 'uuid_mslong': 4929722100064734894}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '4469e421-97c0-4eae-8e9b-a1b2665fee01'}, 'oper': 'CREATE', 'request-id': 'req-7a8f5643-f9b1-442b-a855-39a35e64a570', 'type': 'hardware', 'uuid': '4469e421-97c0-4eae-8e9b-a1b2665fee01'} 01/16/2025 00:53:34.433 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48sh-afo url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48sh-afo"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48sh-afo"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.442 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-1fd99c83-802c-4523-94e7-8d3dfdcca0f8', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:34.447 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-01-16T00:53:34.421430', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-01-16T00:53:34.421430', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11955053070648480908, 'uuid_mslong': 12818867414603679889}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b1e5c3ff-0e48-4891-a5e8-e16d5af2148c', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-d928cf18-7829-4e95-9529-56d3821b3614', 'type': 'alarm', 'uuid': 'b1e5c3ff-0e48-4891-a5e8-e16d5af2148c'} 01/16/2025 00:53:34.473 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48sh-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48sh-afo', 'fq_name': ['juniper-qfx5100-48sh-afo'], 'id_perms': {'created': '2025-01-16T00:53:34.458478', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.458478', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9626837653422060249, 'uuid_mslong': 3242466659055062286}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '2cff8e3f-4106-4d0e-8599-65d73293b2d9'}, 'oper': 'CREATE', 'request-id': 'req-be743ffc-2218-4e7d-9568-bb709af19e53', 'type': 'hardware', 'uuid': '2cff8e3f-4106-4d0e-8599-65d73293b2d9'} 01/16/2025 00:53:34.475 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-0f9deae1-1b24-4e02-8547-6692fab9c248', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:34.533 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afi'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afi', 'fq_name': ['juniper-qfx5100-48th-afi'], 'id_perms': {'created': '2025-01-16T00:53:34.509065', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.509065', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11275611067360325266, 'uuid_mslong': 2022382443623694352}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '1c10f21e-102d-4010-9c7b-04866779ae92'}, 'oper': 'CREATE', 'request-id': 'req-67a046c0-15d6-4831-9df6-8133aa7d41f9', 'type': 'hardware', 'uuid': '1c10f21e-102d-4010-9c7b-04866779ae92'} 01/16/2025 00:53:34.534 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "BGP peer mismatch. Not enough BGP peers are up.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-bgp-connectivity"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.609 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48th-afo'], 'obj_dict': {'display_name': 'juniper-qfx5100-48th-afo', 'fq_name': ['juniper-qfx5100-48th-afo'], 'id_perms': {'created': '2025-01-16T00:53:34.601910', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.601910', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10595621955870665795, 'uuid_mslong': 3340029609457501530}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '2e5a2b3b-cb00-455a-930b-3607e6002c43'}, 'oper': 'CREATE', 'request-id': 'req-a83d75ba-0a7c-4459-8779-2a052f462b38', 'type': 'hardware', 'uuid': '2e5a2b3b-cb00-455a-930b-3607e6002c43'} 01/16/2025 00:53:34.619 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-01-16T00:53:34.593205', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-01-16T00:53:34.593205', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12543188535478560113, 'uuid_mslong': 16046953588979681416}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'deb23b44-ce50-4888-ae12-5b842ff3a571', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-4192c8a1-4753-4d71-af54-1cfffc9bef47', 'type': 'alarm', 'uuid': 'deb23b44-ce50-4888-ae12-5b842ff3a571'} 01/16/2025 00:53:34.646 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48s-6q url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48s-6q"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.670 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48s-6q', 'fq_name': ['juniper-qfx5100-48s-6q'], 'id_perms': {'created': '2025-01-16T00:53:34.656188', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.656188', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11143577610329131659, 'uuid_mslong': 3773608379005881675}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '345e8cd3-c815-4d4b-9aa5-f0cb9eaa0a8b'}, 'oper': 'CREATE', 'request-id': 'req-fa4e6f8d-862b-4cc2-9fc8-66f3f28c57f1', 'type': 'hardware', 'uuid': '345e8cd3-c815-4d4b-9aa5-f0cb9eaa0a8b'} 01/16/2025 00:53:34.683 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "ContrailConfig missing or incorrect. Configuration pushed to Ifmap as ContrailConfig is missing/incorrect.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-conf-incorrect"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.715 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100-96s-8q', 'fq_name': ['juniper-qfx5100-96s-8q'], 'id_perms': {'created': '2025-01-16T00:53:34.700612', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.700612', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13554714399305152815, 'uuid_mslong': 11763006249717419956}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'a33e97dc-6d1b-4fb4-bc1c-04ee2274b92f'}, 'oper': 'CREATE', 'request-id': 'req-69d3adc0-28f6-4a19-86b5-7290eca20fad', 'type': 'hardware', 'uuid': 'a33e97dc-6d1b-4fb4-bc1c-04ee2274b92f'} 01/16/2025 00:53:34.770 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-01-16T00:53:34.739109', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-01-16T00:53:34.739109', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9274175377782615299, 'uuid_mslong': 8071525767212909586}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7003d1eb-a623-4412-80b4-7d5e91682d03', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-0c37512d-7106-4ae9-aad4-99bef186688a', 'type': 'alarm', 'uuid': '7003d1eb-a623-4412-80b4-7d5e91682d03'} 01/16/2025 00:53:34.778 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t', 'fq_name': ['juniper-qfx5100-48t'], 'id_perms': {'created': '2025-01-16T00:53:34.756046', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.756046', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10915147278875162543, 'uuid_mslong': 5272539690957096414}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '492bd2e9-efa5-45de-977a-649e846cf7af'}, 'oper': 'CREATE', 'request-id': 'req-b64f349b-e53c-4929-8995-b5e0c9774f47', 'type': 'hardware', 'uuid': '492bd2e9-efa5-45de-977a-649e846cf7af'} 01/16/2025 00:53:34.796 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100-48t-6q url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100-48t-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100-48t-6q"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.837 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100-48t-6q', 'fq_name': ['juniper-qfx5100-48t-6q'], 'id_perms': {'created': '2025-01-16T00:53:34.808373', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.808373', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9842293262248187233, 'uuid_mslong': 358166323377030033}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '04f8765f-9b65-4391-8896-d99347861561'}, 'oper': 'CREATE', 'request-id': 'req-a13177dc-e38e-496a-9cb9-b48e34fb906e', 'type': 'hardware', 'uuid': '04f8765f-9b65-4391-8896-d99347861561'} 01/16/2025 00:53:34.840 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses high threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-high"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.892 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-2p', 'fq_name': ['juniper-qfx5100-24q-2p'], 'id_perms': {'created': '2025-01-16T00:53:34.874445', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.874445', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12481690469320604481, 'uuid_mslong': 2011583069239526734}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '1bea9424-c636-454e-ad37-df59dc3bbb41'}, 'oper': 'CREATE', 'request-id': 'req-679ad474-2b19-401f-a28f-b23f69f3cbf5', 'type': 'hardware', 'uuid': '1bea9424-c636-454e-ad37-df59dc3bbb41'} 01/16/2025 00:53:34.919 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-01-16T00:53:34.881129', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-01-16T00:53:34.881129', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9513275331357292791, 'uuid_mslong': 5362015949111771857}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4a69b518-b6c9-42d1-8405-f182a809b8f7', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f33e0a99-f516-40fa-9ff0-e5cbb0f102f9', 'type': 'alarm', 'uuid': '4a69b518-b6c9-42d1-8405-f182a809b8f7'} 01/16/2025 00:53:34.966 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-48s-6q url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-48s-6q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-48s-6q"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:34.978 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100-24q-aa'], 'obj_dict': {'display_name': 'juniper-qfx5100-24q-aa', 'fq_name': ['juniper-qfx5100-24q-aa'], 'id_perms': {'created': '2025-01-16T00:53:34.941136', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.941136', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10704121084171943821, 'uuid_mslong': 9268079474675566720}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '809ed52d-8620-4880-948c-ad69c6d67f8d'}, 'oper': 'CREATE', 'request-id': 'req-0fb821a4-3ade-45f7-acf6-96e9276106f3', 'type': 'hardware', 'uuid': '809ed52d-8620-4880-948c-ad69c6d67f8d'} 01/16/2025 00:53:34.983 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Disk usage crosses critical threshold limit.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-disk-usage-critical"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.023 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48s-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48s-6q', 'fq_name': ['juniper-qfx5100e-48s-6q'], 'id_perms': {'created': '2025-01-16T00:53:34.984883', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:34.984883', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10188129449348754281, 'uuid_mslong': 8589350801632480292}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '7733810b-b685-4c24-8d63-81c15220eb69'}, 'oper': 'CREATE', 'request-id': 'req-c90da68c-10d3-49e5-9682-9e1b15a852be', 'type': 'hardware', 'uuid': '7733810b-b685-4c24-8d63-81c15220eb69'} 01/16/2025 00:53:35.032 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-01-16T00:53:35.016057', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.016057', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12926331329384398040, 'uuid_mslong': 6235805789714596117}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '568a0853-b843-4115-b363-8ddb80f5bcd8', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-3584e81f-6e18-4ec0-bf2e-ec36b52f7f65', 'type': 'alarm', 'uuid': '568a0853-b843-4115-b363-8ddb80f5bcd8'} 01/16/2025 00:53:35.038 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-96s-8q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-96s-8q', 'fq_name': ['juniper-qfx5100e-96s-8q'], 'id_perms': {'created': '2025-01-16T00:53:35.023000', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.023000', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10979639993479651372, 'uuid_mslong': 828453468839104119}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '0b7f420a-6318-4e77-985f-8466c506e02c'}, 'oper': 'CREATE', 'request-id': 'req-1d78b3e5-48d3-426e-a96e-cd459a7a6305', 'type': 'hardware', 'uuid': '0b7f420a-6318-4e77-985f-8466c506e02c'} 01/16/2025 00:53:35.079 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-48t-6q'], 'obj_dict': {'display_name': 'juniper-qfx5100e-48t-6q', 'fq_name': ['juniper-qfx5100e-48t-6q'], 'id_perms': {'created': '2025-01-16T00:53:35.064498', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.064498', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10192650243505363511, 'uuid_mslong': 1589612169705965455}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '160f6fd8-a1f6-478f-8d73-9164bbef9a37'}, 'oper': 'CREATE', 'request-id': 'req-886c1478-1506-4296-961c-6f41441e1eca', 'type': 'hardware', 'uuid': '160f6fd8-a1f6-478f-8d73-9164bbef9a37'} 01/16/2025 00:53:35.091 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5100e-24q-2p url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5100e-24q-2p"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5100e-24q-2p"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.093 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Node Failure. NodeStatus UVE not present.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-node-status"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.110 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5100e-24q-2p'], 'obj_dict': {'display_name': 'juniper-qfx5100e-24q-2p', 'fq_name': ['juniper-qfx5100e-24q-2p'], 'id_perms': {'created': '2025-01-16T00:53:35.101525', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.101525', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9745863870449122160, 'uuid_mslong': 18115362610060411201}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'fb66b250-860b-4141-8740-438deb6efb70'}, 'oper': 'CREATE', 'request-id': 'req-ba6731e7-ec7f-451c-928e-cdbf227ffe50', 'type': 'hardware', 'uuid': 'fb66b250-860b-4141-8740-438deb6efb70'} 01/16/2025 00:53:35.124 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-01-16T00:53:35.114300', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.114300', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13423702181644340219, 'uuid_mslong': 15864512690799004387}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-9992f14c-3edb-4dd1-b0df-584cec6a5800', 'type': 'alarm', 'uuid': 'dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb'} 01/16/2025 00:53:35.185 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "System Info Incomplete.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-partial-sysinfo"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.192 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-48s-4c'], 'obj_dict': {'display_name': 'juniper-qfx5110-48s-4c', 'fq_name': ['juniper-qfx5110-48s-4c'], 'id_perms': {'created': '2025-01-16T00:53:35.179311', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.179311', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11531115622216118982, 'uuid_mslong': 13792916050593926534}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'bf6a4811-ec6f-4d86-a006-c0905e2632c6'}, 'oper': 'CREATE', 'request-id': 'req-62f30d93-2afd-4681-a9b8-274674e6fde2', 'type': 'hardware', 'uuid': 'bf6a4811-ec6f-4d86-a006-c0905e2632c6'} 01/16/2025 00:53:35.233 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5110-32q'], 'obj_dict': {'display_name': 'juniper-qfx5110-32q', 'fq_name': ['juniper-qfx5110-32q'], 'id_perms': {'created': '2025-01-16T00:53:35.218888', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.218888', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13672123756133826427, 'uuid_mslong': 8681866455281650419}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '787c2f8a-e671-4af3-bdbd-241e41893f7b'}, 'oper': 'CREATE', 'request-id': 'req-cce71be9-7ab9-4657-a432-8810eec64c71', 'type': 'hardware', 'uuid': '787c2f8a-e671-4af3-bdbd-241e41893f7b'} 01/16/2025 00:53:35.240 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-01-16T00:53:35.221427', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.221427', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9494403541784404930, 'uuid_mslong': 2535666367233543929}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '23307f20-5fdc-4ef9-83c2-e5b7be4523c2', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-f49c5d86-85ad-402f-8d01-cc4616627f15', 'type': 'alarm', 'uuid': '23307f20-5fdc-4ef9-83c2-e5b7be4523c2'} 01/16/2025 00:53:35.249 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5120-48y-8c url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5120-48y-8c"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5120-48y-8c"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.273 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48y-8c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48y-8c', 'fq_name': ['juniper-qfx5120-48y-8c'], 'id_perms': {'created': '2025-01-16T00:53:35.258700', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.258700', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13732958131581689518, 'uuid_mslong': 7696410776543381334}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '6acf24d2-ed5b-4756-be95-44a90c3d1eae'}, 'oper': 'CREATE', 'request-id': 'req-f91534b4-feea-4ec7-8ed2-a85048bcddcd', 'type': 'hardware', 'uuid': '6acf24d2-ed5b-4756-be95-44a90c3d1eae'} 01/16/2025 00:53:35.313 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-32c'], 'obj_dict': {'display_name': 'juniper-qfx5120-32c', 'fq_name': ['juniper-qfx5120-32c'], 'id_perms': {'created': '2025-01-16T00:53:35.297937', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.297937', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13262901297474076402, 'uuid_mslong': 4468973885010823560}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '3e04fc12-1e91-4988-b80f-4a75cf027ef2'}, 'oper': 'CREATE', 'request-id': 'req-5af03bb5-52ef-4650-95d4-484727deb92e', 'type': 'hardware', 'uuid': '3e04fc12-1e91-4988-b80f-4a75cf027ef2'} 01/16/2025 00:53:35.337 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process(es) reporting as non-functional.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-connectivity"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.375 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-01-16T00:53:35.362424', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.362424', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12674114593398540620, 'uuid_mslong': 16400824437591394298}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e39b6eee-422e-47fa-afe3-8012861d494c', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-238ee9f1-3124-4efa-9e0e-142992d69001', 'type': 'alarm', 'uuid': 'e39b6eee-422e-47fa-afe3-8012861d494c'} 01/16/2025 00:53:35.378 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5120-48t-6c'], 'obj_dict': {'display_name': 'juniper-qfx5120-48t-6c', 'fq_name': ['juniper-qfx5120-48t-6c'], 'id_perms': {'created': '2025-01-16T00:53:35.362132', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.362132', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12747574175873543930, 'uuid_mslong': 8517654660762455173}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '7634c9c9-1632-4c85-b0e8-7b2c64e2aefa'}, 'oper': 'CREATE', 'request-id': 'req-f2ea72c7-8412-408c-bf15-81f440ebc3e3', 'type': 'hardware', 'uuid': '7634c9c9-1632-4c85-b0e8-7b2c64e2aefa'} 01/16/2025 00:53:35.389 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5220-32cd url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5220-32cd"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220-32cd"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.417 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-32cd'], 'obj_dict': {'display_name': 'juniper-qfx5220-32cd', 'fq_name': ['juniper-qfx5220-32cd'], 'id_perms': {'created': '2025-01-16T00:53:35.402458', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.402458', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12001389514745443301, 'uuid_mslong': 8900232333951518739}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '7b83fa26-fba0-4813-a68d-802d757ff3e5'}, 'oper': 'CREATE', 'request-id': 'req-dcfa36d0-f650-4f74-b342-d7b53e50b1d3', 'type': 'hardware', 'uuid': '7b83fa26-fba0-4813-a68d-802d757ff3e5'} 01/16/2025 00:53:35.445 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Process Failure.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-process-status"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.466 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5220-128c'], 'obj_dict': {'display_name': 'juniper-qfx5220-128c', 'fq_name': ['juniper-qfx5220-128c'], 'id_perms': {'created': '2025-01-16T00:53:35.451933', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.451933', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10289388075476188852, 'uuid_mslong': 2075618527831738797}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '1cce140d-d0a1-49ad-8ecb-3ff06ae5feb4'}, 'oper': 'CREATE', 'request-id': 'req-85c5eeeb-f4d0-4509-b7e5-6ae6ccfd6437', 'type': 'hardware', 'uuid': '1cce140d-d0a1-49ad-8ecb-3ff06ae5feb4'} 01/16/2025 00:53:35.478 7f984513cac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:35.485 7f984513cac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:35.485 7f984513cac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:35.485 7f984513cac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:35.486 7f984513cac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:35.486 7f984513cac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:35.486 7f984513cac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:35.487 7f984513cac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:35.488 7f984513cac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:35.488 7f984513cac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:35.488 7f984513cac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:35.488 7f984513cac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:35.488 7f984513cac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:35.488 7f984513cac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:35.513 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-32c-32q'], 'obj_dict': {'display_name': 'juniper-qfx5200-32c-32q', 'fq_name': ['juniper-qfx5200-32c-32q'], 'id_perms': {'created': '2025-01-16T00:53:35.501787', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.501787', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9983047826007663059, 'uuid_mslong': 7141790276851286454}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '631cbc6b-000f-41b6-8a8a-e91af4ec21d3'}, 'oper': 'CREATE', 'request-id': 'req-9bfb5282-74c2-4478-933c-4c967ce9c950', 'type': 'hardware', 'uuid': '631cbc6b-000f-41b6-8a8a-e91af4ec21d3'} 01/16/2025 00:53:35.522 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-01-16T00:53:35.500642', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.500642', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10926522054336686327, 'uuid_mslong': 15508027532616353554}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd73794e0-3893-4712-97a2-cdeacf35a8f7', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-aa80d4bc-ecbd-41b0-a645-c7ffdeec2c25', 'type': 'alarm', 'uuid': 'd73794e0-3893-4712-97a2-cdeacf35a8f7'} 01/16/2025 00:53:35.535 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx5200-48y url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx5200-48y"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5200-48y"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.572 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5200-48y'], 'obj_dict': {'display_name': 'juniper-qfx5200-48y', 'fq_name': ['juniper-qfx5200-48y'], 'id_perms': {'created': '2025-01-16T00:53:35.548976', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.548976', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13188508290509199530, 'uuid_mslong': 4372096587731585647}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '3cacceae-a370-4a6f-b706-fe6a1d1858aa'}, 'oper': 'CREATE', 'request-id': 'req-b348e045-9d4e-4c6e-b4f1-0da8415c94f4', 'type': 'hardware', 'uuid': '3cacceae-a370-4a6f-b706-fe6a1d1858aa'} 01/16/2025 00:53:35.578 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tor agent does not exist we look for non-empty value for connected_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-connectivity"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.609 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx5210-64c'], 'obj_dict': {'display_name': 'juniper-qfx5210-64c', 'fq_name': ['juniper-qfx5210-64c'], 'id_perms': {'created': '2025-01-16T00:53:35.597094', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.597094', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13487340596102167602, 'uuid_mslong': 15989424196623551761}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'dde5d897-5ac8-4d11-bb2c-a8d02b5ffc32'}, 'oper': 'CREATE', 'request-id': 'req-2a7363f0-b489-4ecd-8fd7-0a5fa4a6971e', 'type': 'hardware', 'uuid': 'dde5d897-5ac8-4d11-bb2c-a8d02b5ffc32'} 01/16/2025 00:53:35.649 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-01-16T00:53:35.620963', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-01-16T00:53:35.620963', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10199624013114069807, 'uuid_mslong': 8230147268085696019}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '72375b55-cb66-4613-8d8c-58000035532f', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-a576f923-9b90-4ae1-8925-7d9c07cf68ce', 'type': 'alarm', 'uuid': '72375b55-cb66-4613-8d8c-58000035532f'} 01/16/2025 00:53:35.665 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-72q'], 'obj_dict': {'display_name': 'juniper-qfx10002-72q', 'fq_name': ['juniper-qfx10002-72q'], 'id_perms': {'created': '2025-01-16T00:53:35.652596', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.652596', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10311265918845458188, 'uuid_mslong': 1830728312403674579}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '19680db3-5512-45d3-8f18-f9b8c560170c'}, 'oper': 'CREATE', 'request-id': 'req-26121e2f-551d-4090-8bcc-9cbfea964af3', 'type': 'hardware', 'uuid': '19680db3-5512-45d3-8f18-f9b8c560170c'} 01/16/2025 00:53:35.679 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10002-36q url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10002-36q"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10002-36q"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.713 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-36q'], 'obj_dict': {'display_name': 'juniper-qfx10002-36q', 'fq_name': ['juniper-qfx10002-36q'], 'id_perms': {'created': '2025-01-16T00:53:35.695120', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.695120', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12649328361537458423, 'uuid_mslong': 8348957834544566211}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '73dd74ea-74be-4fc3-af8b-712034b6d0f7'}, 'oper': 'CREATE', 'request-id': 'req-4371619a-85dc-47e8-b47c-6b800a6601ca', 'type': 'hardware', 'uuid': '73dd74ea-74be-4fc3-af8b-712034b6d0f7'} 01/16/2025 00:53:35.716 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Prouter connectivity to controlling tsn agent does not exist we look for non-empty value for tsn_agent_list", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-prouter-tsn-connectivity"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.756 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10002-60c'], 'obj_dict': {'display_name': 'juniper-qfx10002-60c', 'fq_name': ['juniper-qfx10002-60c'], 'id_perms': {'created': '2025-01-16T00:53:35.743085', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.743085', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9887818595483830191, 'uuid_mslong': 1179600452500671725}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '105ec85c-9c31-4ced-8938-969feb50c7af'}, 'oper': 'CREATE', 'request-id': 'req-776eb6c0-7926-4be8-9ca7-0730c8133756', 'type': 'hardware', 'uuid': '105ec85c-9c31-4ced-8938-969feb50c7af'} 01/16/2025 00:53:35.768 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-01-16T00:53:35.746051', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-01-16T00:53:35.746051', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9530130086667656346, 'uuid_mslong': 8916172746926344517}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7bbc9bdf-9890-4945-8441-d2d22f169c9a', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-d8a58466-e626-4ca3-9c00-df5145d643c0', 'type': 'alarm', 'uuid': '7bbc9bdf-9890-4945-8441-d2d22f169c9a'} 01/16/2025 00:53:35.822 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10016'], 'obj_dict': {'display_name': 'juniper-qfx10016', 'fq_name': ['juniper-qfx10016'], 'id_perms': {'created': '2025-01-16T00:53:35.809322', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.809322', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12794200029352185450, 'uuid_mslong': 12149735682687781615}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'a89c883b-397e-4aef-b18e-2123ded44e6a'}, 'oper': 'CREATE', 'request-id': 'req-10898706-6e76-45cf-a099-4bd6d46af63a', 'type': 'hardware', 'uuid': 'a89c883b-397e-4aef-b18e-2123ded44e6a'} 01/16/2025 00:53:35.831 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Storage Cluster warning/errors.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-storage-cluster-state"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.839 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-qfx10008 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-qfx10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx10008"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.863 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-qfx10008'], 'obj_dict': {'display_name': 'juniper-qfx10008', 'fq_name': ['juniper-qfx10008'], 'id_perms': {'created': '2025-01-16T00:53:35.849694', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.849694', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13559467022077483839, 'uuid_mslong': 8600681389185188955}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '775bc227-b4b2-445b-bc2c-e76a5a8d5b3f'}, 'oper': 'CREATE', 'request-id': 'req-76320c6e-5d14-47d7-bc8f-490938be033e', 'type': 'hardware', 'uuid': '775bc227-b4b2-445b-bc2c-e76a5a8d5b3f'} 01/16/2025 00:53:35.887 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-01-16T00:53:35.869093', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.869093', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11099164196454471043, 'uuid_mslong': 12891032813845958437}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b2e6260b-6931-4f25-9a08-2707e1671583', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-b7554b66-aa35-42fb-a6d0-cd6caaf80b3c', 'type': 'alarm', 'uuid': 'b2e6260b-6931-4f25-9a08-2707e1671583'} 01/16/2025 00:53:35.902 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vqfx-10000'], 'obj_dict': {'display_name': 'juniper-vqfx-10000', 'fq_name': ['juniper-vqfx-10000'], 'id_perms': {'created': '2025-01-16T00:53:35.889526', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.889526', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11541002498680399975, 'uuid_mslong': 4699590789401822348}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '41384cec-67fe-448c-a029-e0a02dbda867'}, 'oper': 'CREATE', 'request-id': 'req-a5c06586-b7d8-4980-969b-b7518bcc27b8', 'type': 'hardware', 'uuid': '41384cec-67fe-448c-a029-e0a02dbda867'} 01/16/2025 00:53:35.943 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Vrouter interface(s) down.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-interface"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.958 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80'], 'obj_dict': {'display_name': 'juniper-mx80', 'fq_name': ['juniper-mx80'], 'id_perms': {'created': '2025-01-16T00:53:35.941524', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.941524', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10369199198580222929, 'uuid_mslong': 5865001587097879940}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '5164abde-8e12-4584-8fe6-cbbb94a3abd1'}, 'oper': 'CREATE', 'request-id': 'req-95f4c91c-2264-4cff-b08c-33d95a959099', 'type': 'hardware', 'uuid': '5164abde-8e12-4584-8fe6-cbbb94a3abd1'} 01/16/2025 00:53:35.963 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1044ae6c-03b7-4661-be7f-6c9c38e339cc object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.43:8082/alarm/1044ae6c-03b7-4661-be7f-6c9c38e339cc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "1044ae6c-03b7-4661-be7f-6c9c38e339cc", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.977 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx80-48t url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx80-48t"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx80-48t"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:35.999 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-01-16T00:53:35.982862', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-01-16T00:53:35.982862', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13021473561735677283, 'uuid_mslong': 4018980323507850260}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '37c6494f-8df8-4c14-b4b5-9136b3654563', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-8cab7d29-2c5f-48cf-a2ab-92ada7abd2b5', 'type': 'alarm', 'uuid': '37c6494f-8df8-4c14-b4b5-9136b3654563'} 01/16/2025 00:53:36.004 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-c07a9b9f-6e0e-442c-bda5-5a012c09c44c', 'type': 'alarm', 'uuid': '1044ae6c-03b7-4661-be7f-6c9c38e339cc'} 01/16/2025 00:53:36.011 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx80-48t'], 'obj_dict': {'display_name': 'juniper-mx80-48t', 'fq_name': ['juniper-mx80-48t'], 'id_perms': {'created': '2025-01-16T00:53:35.988215', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:35.988215', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13250559402859411179, 'uuid_mslong': 13239080662976317412}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'b7baa9b8-2572-47e4-b7e3-71928aa5b6eb'}, 'oper': 'CREATE', 'request-id': 'req-f9c50172-adf3-4f13-9b12-d9966f584c37', 'type': 'hardware', 'uuid': 'b7baa9b8-2572-47e4-b7e3-71928aa5b6eb'} 01/16/2025 00:53:36.013 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1044ae6c-03b7-4661-be7f-6c9c38e339cc object_type = alarm identifier_name = default-global-system-config:system-defined-conf-elements-inconsistency url = http://10.0.0.43:8082/alarm/1044ae6c-03b7-4661-be7f-6c9c38e339cc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "1044ae6c-03b7-4661-be7f-6c9c38e339cc", "fq_name": ["default-global-system-config", "system-defined-conf-elements-inconsistency"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements", "operation": "size==", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.038 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'oper': 'UPDATE', 'request-id': 'req-b136dfec-bf0a-4dcd-8b00-e8380661b290', 'type': 'alarm', 'uuid': '1044ae6c-03b7-4661-be7f-6c9c38e339cc'} 01/16/2025 00:53:36.065 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx204'], 'obj_dict': {'display_name': 'juniper-mx204', 'fq_name': ['juniper-mx204'], 'id_perms': {'created': '2025-01-16T00:53:36.047031', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.047031', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12247946265675381035, 'uuid_mslong': 5462451778740832804}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '4bce86f3-928c-4a24-a9f9-723c79a7392b'}, 'oper': 'CREATE', 'request-id': 'req-c349bd59-6924-461c-9209-527dc4384d4e', 'type': 'hardware', 'uuid': '4bce86f3-928c-4a24-a9f9-723c79a7392b'} 01/16/2025 00:53:36.074 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP peer mismatch.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-connectivity"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.107 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx240'], 'obj_dict': {'display_name': 'juniper-mx240', 'fq_name': ['juniper-mx240'], 'id_perms': {'created': '2025-01-16T00:53:36.099477', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.099477', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10316700617187756085, 'uuid_mslong': 12465271495538527626}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'acfd8a61-a060-4d8a-8f2c-488d15878835'}, 'oper': 'CREATE', 'request-id': 'req-8f7480c2-0146-48eb-8795-b628e6bb277b', 'type': 'hardware', 'uuid': 'acfd8a61-a060-4d8a-8f2c-488d15878835'} 01/16/2025 00:53:36.124 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-01-16T00:53:36.104918', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.104918', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11118959919335791879, 'uuid_mslong': 6310385084571862655}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-2b5e6e9c-e914-435b-bd95-28fa24516fc1', 'type': 'alarm', 'uuid': '5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07'} 01/16/2025 00:53:36.126 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx480 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx480"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx480"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.147 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx480'], 'obj_dict': {'display_name': 'juniper-mx480', 'fq_name': ['juniper-mx480'], 'id_perms': {'created': '2025-01-16T00:53:36.139180', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.139180', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12613032258946109978, 'uuid_mslong': 17503449410116273510}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'f2e8be80-5200-4566-af0a-7e034706921a'}, 'oper': 'CREATE', 'request-id': 'req-523037b5-94a6-4169-92d9-ee1de61dcd4c', 'type': 'hardware', 'uuid': 'f2e8be80-5200-4566-af0a-7e034706921a'} 01/16/2025 00:53:36.173 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4cef6082-c6c6-412c-8a80-9e1cdbb7b239 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.43:8082/alarm/4cef6082-c6c6-412c-8a80-9e1cdbb7b239 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "4cef6082-c6c6-412c-8a80-9e1cdbb7b239", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.180 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "XMPP connection closed towards peer, alarm has close reason", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-xmpp-close-reason"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.195 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4cef6082-c6c6-412c-8a80-9e1cdbb7b239 object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-compute url = http://10.0.0.43:8082/alarm/4cef6082-c6c6-412c-8a80-9e1cdbb7b239 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "4cef6082-c6c6-412c-8a80-9e1cdbb7b239", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-compute"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_ip_address", "operation": "!=", "operand2": {"uve_attribute": "VrouterAgent.control_ip"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.211 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-14701aa7-f35c-4849-bed5-d5f0b8b218b3', 'type': 'alarm', 'uuid': '4cef6082-c6c6-412c-8a80-9e1cdbb7b239'} 01/16/2025 00:53:36.231 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx960'], 'obj_dict': {'display_name': 'juniper-mx960', 'fq_name': ['juniper-mx960'], 'id_perms': {'created': '2025-01-16T00:53:36.218925', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.218925', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12841626612482358041, 'uuid_mslong': 5394757899326341770}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '4ade07ba-0e94-428a-b236-9f5dbf36bb19'}, 'oper': 'CREATE', 'request-id': 'req-2020f24a-7f6e-4e8a-a67f-8eac018bee2e', 'type': 'hardware', 'uuid': '4ade07ba-0e94-428a-b236-9f5dbf36bb19'} 01/16/2025 00:53:36.243 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'oper': 'UPDATE', 'request-id': 'req-f24b8cbe-94cd-4953-bcea-54add2cd2d9a', 'type': 'alarm', 'uuid': '4cef6082-c6c6-412c-8a80-9e1cdbb7b239'} 01/16/2025 00:53:36.252 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-01-16T00:53:36.224055', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-01-16T00:53:36.224055', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13167805588870205279, 'uuid_mslong': 3182920385934150824}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2c2c013a-27f4-4ca8-b6bd-716ac4030f5f', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-3bfa2597-4255-4d56-9bff-785764fbed1b', 'type': 'alarm', 'uuid': '2c2c013a-27f4-4ca8-b6bd-716ac4030f5f'} 01/16/2025 00:53:36.311 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "A core file has been generated on the node.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-core-files"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.323 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2008'], 'obj_dict': {'display_name': 'juniper-mx2008', 'fq_name': ['juniper-mx2008'], 'id_perms': {'created': '2025-01-16T00:53:36.311071', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.311071', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9634710819765756427, 'uuid_mslong': 3891175981700892871}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '36003bf0-63d0-48c7-85b5-5e7195c0220b'}, 'oper': 'CREATE', 'request-id': 'req-6fa85b55-ddef-4fcf-9810-dc417f159c4e', 'type': 'hardware', 'uuid': '36003bf0-63d0-48c7-85b5-5e7195c0220b'} 01/16/2025 00:53:36.338 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-mx2010 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-mx2010"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-mx2010"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.368 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2010'], 'obj_dict': {'display_name': 'juniper-mx2010', 'fq_name': ['juniper-mx2010'], 'id_perms': {'created': '2025-01-16T00:53:36.351370', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.351370', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10874796949318436879, 'uuid_mslong': 18000021987769992125}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'f9cceca1-3240-43bd-96eb-0a3550a0880f'}, 'oper': 'CREATE', 'request-id': 'req-10ee1669-2cc9-4243-a691-a729de1b0d35', 'type': 'hardware', 'uuid': 'f9cceca1-3240-43bd-96eb-0a3550a0880f'} 01/16/2025 00:53:36.381 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-01-16T00:53:36.351819', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.351819', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11536512864041212014, 'uuid_mslong': 15563931435393631690}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd7fe312d-e32c-45ca-a019-ed53a7e6986e', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-35c3330a-1768-48ec-a67e-2bea520419c1', 'type': 'alarm', 'uuid': 'd7fe312d-e32c-45ca-a019-ed53a7e6986e'} 01/16/2025 00:53:36.386 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b1e5c3ff-0e48-4891-a5e8-e16d5af2148c object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.43:8082/alarm/b1e5c3ff-0e48-4891-a5e8-e16d5af2148c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "b1e5c3ff-0e48-4891-a5e8-e16d5af2148c", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.404 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b1e5c3ff-0e48-4891-a5e8-e16d5af2148c object_type = alarm identifier_name = default-global-system-config:system-defined-address-mismatch-control url = http://10.0.0.43:8082/alarm/b1e5c3ff-0e48-4891-a5e8-e16d5af2148c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "b1e5c3ff-0e48-4891-a5e8-e16d5af2148c", "fq_name": ["default-global-system-config", "system-defined-address-mismatch-control"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.bgp_router_parameters.address", "operation": "not in", "operand2": {"uve_attribute": "BgpRouterState.bgp_router_ip_list"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.418 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx2020'], 'obj_dict': {'display_name': 'juniper-mx2020', 'fq_name': ['juniper-mx2020'], 'id_perms': {'created': '2025-01-16T00:53:36.411434', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.411434', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9760620494270153218, 'uuid_mslong': 1261157048000925042}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '118087a7-3c13-4d72-8774-b0a0245ec202'}, 'oper': 'CREATE', 'request-id': 'req-e8ac538e-0db2-431c-9bf1-b6d5688dacff', 'type': 'hardware', 'uuid': '118087a7-3c13-4d72-8774-b0a0245ec202'} 01/16/2025 00:53:36.427 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-25845a70-cbf5-4dfa-a719-099a2c9d7ad7', 'type': 'alarm', 'uuid': 'b1e5c3ff-0e48-4891-a5e8-e16d5af2148c'} 01/16/2025 00:53:36.438 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'oper': 'UPDATE', 'request-id': 'req-c5bc6a09-c850-43cd-b3c7-90d2299fb53f', 'type': 'alarm', 'uuid': 'b1e5c3ff-0e48-4891-a5e8-e16d5af2148c'} 01/16/2025 00:53:36.439 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Pending compaction tasks in cassandra crossed the configured threshold.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-pending-cassandra-compaction-tasks"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.463 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-mx10003'], 'obj_dict': {'display_name': 'juniper-mx10003', 'fq_name': ['juniper-mx10003'], 'id_perms': {'created': '2025-01-16T00:53:36.453807', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.453807', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9907051277541475467, 'uuid_mslong': 15418920398389264937}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'd5fb0268-ce04-4229-897c-eaa5a970848b'}, 'oper': 'CREATE', 'request-id': 'req-3fcd8915-b678-413e-8c7b-23f8baef4afc', 'type': 'hardware', 'uuid': 'd5fb0268-ce04-4229-897c-eaa5a970848b'} 01/16/2025 00:53:36.482 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-jnp10008 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-jnp10008"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-jnp10008"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.489 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-01-16T00:53:36.466151', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.466151', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9469931218191219533, 'uuid_mslong': 17345370056926908257}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f0b7222a-c4d3-4f61-836b-f444e3ab7b4d', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-74dc8338-3fd8-4b68-ab6e-489fec12f615', 'type': 'alarm', 'uuid': 'f0b7222a-c4d3-4f61-836b-f444e3ab7b4d'} 01/16/2025 00:53:36.505 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10008'], 'obj_dict': {'display_name': 'juniper-jnp10008', 'fq_name': ['juniper-jnp10008'], 'id_perms': {'created': '2025-01-16T00:53:36.495571', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.495571', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10391065254968140774, 'uuid_mslong': 1666720487614137371}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '17216173-ec1b-441b-9034-7acb9047a3e6'}, 'oper': 'CREATE', 'request-id': 'req-0e2efa84-0ac4-4d0e-b3e2-c18325c24784', 'type': 'hardware', 'uuid': '17216173-ec1b-441b-9034-7acb9047a3e6'} 01/16/2025 00:53:36.550 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-jnp10016'], 'obj_dict': {'display_name': 'juniper-jnp10016', 'fq_name': ['juniper-jnp10016'], 'id_perms': {'created': '2025-01-16T00:53:36.534150', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.534150', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12648159046681853595, 'uuid_mslong': 16763302057964489928}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'e8a33667-eb8c-4cc8-af87-49a3e01d7e9b'}, 'oper': 'CREATE', 'request-id': 'req-40737851-0ddf-4ec4-95fe-7ad85282a27a', 'type': 'hardware', 'uuid': 'e8a33667-eb8c-4cc8-af87-49a3e01d7e9b'} 01/16/2025 00:53:36.563 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "There is a mismatch between installed and running package version.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-package-version-mismatch"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.582 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = deb23b44-ce50-4888-ae12-5b842ff3a571 object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.43:8082/alarm/deb23b44-ce50-4888-ae12-5b842ff3a571 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "deb23b44-ce50-4888-ae12-5b842ff3a571", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.606 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vmx'], 'obj_dict': {'display_name': 'juniper-vmx', 'fq_name': ['juniper-vmx'], 'id_perms': {'created': '2025-01-16T00:53:36.592080', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.592080', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12315004037376752335, 'uuid_mslong': 13022818459607318762}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'b4ba5864-234b-40ea-aae7-aeec9f57bacf'}, 'oper': 'CREATE', 'request-id': 'req-02c88f14-9e44-4b9c-a2c8-0f77e8684d4b', 'type': 'hardware', 'uuid': 'b4ba5864-234b-40ea-aae7-aeec9f57bacf'} 01/16/2025 00:53:36.616 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = deb23b44-ce50-4888-ae12-5b842ff3a571 object_type = alarm identifier_name = default-global-system-config:system-defined-bgp-connectivity url = http://10.0.0.43:8082/alarm/deb23b44-ce50-4888-ae12-5b842ff3a571 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "deb23b44-ce50-4888-ae12-5b842ff3a571", "fq_name": ["default-global-system-config", "system-defined-bgp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_bgp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_bgp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.618 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-01-16T00:53:36.600053', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.600053', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13157607892738714044, 'uuid_mslong': 7283356767463034339}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6513ae64-2112-4de3-b699-36aa9c9129bc', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-cbedff8b-ea0a-4588-99c4-26cfd710ab14', 'type': 'alarm', 'uuid': '6513ae64-2112-4de3-b699-36aa9c9129bc'} 01/16/2025 00:53:36.626 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5400 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5400"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5400"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.633 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-8778b648-ad9d-45a0-bc6a-9e66a68dd24d', 'type': 'alarm', 'uuid': 'deb23b44-ce50-4888-ae12-5b842ff3a571'} 01/16/2025 00:53:36.650 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-acf46d01-943e-4631-a1e8-1de89d2c1a87', 'type': 'alarm', 'uuid': 'deb23b44-ce50-4888-ae12-5b842ff3a571'} 01/16/2025 00:53:36.665 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5400'], 'obj_dict': {'display_name': 'juniper-srx5400', 'fq_name': ['juniper-srx5400'], 'id_perms': {'created': '2025-01-16T00:53:36.639864', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.639864', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13207710759187982059, 'uuid_mslong': 8062328439540238910}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '6fe324ff-ed53-4a3e-b74b-36f5418126eb'}, 'oper': 'CREATE', 'request-id': 'req-2aa97720-1a9d-4ced-ac48-09e92bd8c9a2', 'type': 'hardware', 'uuid': '6fe324ff-ed53-4a3e-b74b-36f5418126eb'} 01/16/2025 00:53:36.678 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded configured watermark for resource.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-limit-exceeded"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.708 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5600'], 'obj_dict': {'display_name': 'juniper-srx5600', 'fq_name': ['juniper-srx5600'], 'id_perms': {'created': '2025-01-16T00:53:36.680300', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.680300', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11242299384925636410, 'uuid_mslong': 13441511818388196854}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'ba89d7c8-5b3e-4df6-9c04-abb9f115c73a'}, 'oper': 'CREATE', 'request-id': 'req-4e47de83-ba15-4681-b5d9-7c00402042f9', 'type': 'hardware', 'uuid': 'ba89d7c8-5b3e-4df6-9c04-abb9f115c73a'} 01/16/2025 00:53:36.755 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-01-16T00:53:36.732384', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.732384', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10936766786244453882, 'uuid_mslong': 4451913247491902719}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3dc85f82-e79c-4cff-97c7-3372556425fa', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e5229aea-303d-4bcf-822e-5dbc1909bf79', 'type': 'alarm', 'uuid': '3dc85f82-e79c-4cff-97c7-3372556425fa'} 01/16/2025 00:53:36.764 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4600'], 'obj_dict': {'display_name': 'juniper-srx4600', 'fq_name': ['juniper-srx4600'], 'id_perms': {'created': '2025-01-16T00:53:36.746005', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.746005', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9940761181631614438, 'uuid_mslong': 1750398628446487863}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '184aaa47-4fe2-4537-89f4-ada054250de6'}, 'oper': 'CREATE', 'request-id': 'req-bab21be0-06e0-44fd-abe8-fd721e5e3855', 'type': 'hardware', 'uuid': '184aaa47-4fe2-4537-89f4-ada054250de6'} 01/16/2025 00:53:36.774 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx4100 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx4100"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx4100"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.787 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7003d1eb-a623-4412-80b4-7d5e91682d03 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.43:8082/alarm/7003d1eb-a623-4412-80b4-7d5e91682d03 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "7003d1eb-a623-4412-80b4-7d5e91682d03", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.807 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4100'], 'obj_dict': {'display_name': 'juniper-srx4100', 'fq_name': ['juniper-srx4100'], 'id_perms': {'created': '2025-01-16T00:53:36.785876', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.785876', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12154317228867414495, 'uuid_mslong': 7635122678178072164}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '69f5679f-8955-4664-a8ac-cf1f920d69df'}, 'oper': 'CREATE', 'request-id': 'req-2327bd63-f28c-4346-a4c1-39c1db59e3fb', 'type': 'hardware', 'uuid': '69f5679f-8955-4664-a8ac-cf1f920d69df'} 01/16/2025 00:53:36.816 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "Agent resource usage exceeded table size for resource in vrouter.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-table-limit-exceeded"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.832 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7003d1eb-a623-4412-80b4-7d5e91682d03 object_type = alarm identifier_name = default-global-system-config:system-defined-conf-incorrect url = http://10.0.0.43:8082/alarm/7003d1eb-a623-4412-80b4-7d5e91682d03 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "7003d1eb-a623-4412-80b4-7d5e91682d03", "fq_name": ["default-global-system-config", "system-defined-conf-incorrect"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.850 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx1500'], 'obj_dict': {'display_name': 'juniper-srx1500', 'fq_name': ['juniper-srx1500'], 'id_perms': {'created': '2025-01-16T00:53:36.841062', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.841062', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9794742977840384303, 'uuid_mslong': 18194807701928561447}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'fc80f134-65fe-4b27-87ed-ead7f46d892f'}, 'oper': 'CREATE', 'request-id': 'req-279eb8f1-0942-46f5-9f2b-d35bd6b4345c', 'type': 'hardware', 'uuid': 'fc80f134-65fe-4b27-87ed-ead7f46d892f'} 01/16/2025 00:53:36.853 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-2f96cbee-6304-41c7-ba7b-791e7b889ccb', 'type': 'alarm', 'uuid': '7003d1eb-a623-4412-80b4-7d5e91682d03'} 01/16/2025 00:53:36.889 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'oper': 'UPDATE', 'request-id': 'req-c5c1c0dc-93e0-4985-830d-5cc5d7967c6d', 'type': 'alarm', 'uuid': '7003d1eb-a623-4412-80b4-7d5e91682d03'} 01/16/2025 00:53:36.897 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx240h-poe'], 'obj_dict': {'display_name': 'juniper-srx240h-poe', 'fq_name': ['juniper-srx240h-poe'], 'id_perms': {'created': '2025-01-16T00:53:36.886992', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.886992', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10423605156191514077, 'uuid_mslong': 16011214188280565399}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'de334279-2328-4e97-90a8-15a9b5b9addd'}, 'oper': 'CREATE', 'request-id': 'req-2c6c24b4-f863-4a8d-b263-f1e7c9b2df58', 'type': 'hardware', 'uuid': 'de334279-2328-4e97-90a8-15a9b5b9addd'} 01/16/2025 00:53:36.899 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-01-16T00:53:36.876473', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.876473', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12026567816247887284, 'uuid_mslong': 840732906083729427}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0baae21f-aa1a-4013-a6e6-f3b59a99c5b4', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-57066814-6cc0-49bd-8681-7dc0ee52b33a', 'type': 'alarm', 'uuid': '0baae21f-aa1a-4013-a6e6-f3b59a99c5b4'} 01/16/2025 00:53:36.922 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = hardware identifier_name = juniper-srx5800 url = http://10.0.0.43:8082/hardwares operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"hardware": {"uuid": null, "fq_name": ["juniper-srx5800"], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "52d02cefd9d044d58eec4786b30f7bd4", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx5800"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.947 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx5800'], 'obj_dict': {'display_name': 'juniper-srx5800', 'fq_name': ['juniper-srx5800'], 'id_perms': {'created': '2025-01-16T00:53:36.936653', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.936653', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11871641607930020072, 'uuid_mslong': 14049275725838959033}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'c2f90dd6-1e26-41b9-a4c0-8b24cd6a80e8'}, 'oper': 'CREATE', 'request-id': 'req-3c8f15d3-643c-4fcf-85dd-31fc0aa5e5a9', 'type': 'hardware', 'uuid': 'c2f90dd6-1e26-41b9-a4c0-8b24cd6a80e8'} 01/16/2025 00:53:36.950 7f9844f552e8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.43:8082/alarms operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.29 body = {"alarm": {"uuid": null, "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": "On l3 multihomed compute one or more physical interfaces are Inactive.", "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "system-defined-vrouter-l3mh-physical-interface-link-down"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:36.990 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-srx4200'], 'obj_dict': {'display_name': 'juniper-srx4200', 'fq_name': ['juniper-srx4200'], 'id_perms': {'created': '2025-01-16T00:53:36.975615', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:36.975615', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11063537100811222637, 'uuid_mslong': 10336177512928920564}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': '8f717aaf-4182-43f4-9989-946045353e6d'}, 'oper': 'CREATE', 'request-id': 'req-47599bac-47a2-45d0-8e9c-1b21b9f99b79', 'type': 'hardware', 'uuid': '8f717aaf-4182-43f4-9989-946045353e6d'} 01/16/2025 00:53:36.997 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-01-16T00:53:36.980504', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-01-16T00:53:36.980504', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13044747803000726166, 'uuid_mslong': 12744800496957538392}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b0dea086-f260-4058-b508-4103466a6296', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-feaa568c-5edf-479a-bcbf-fcaaf303f087', 'type': 'alarm', 'uuid': 'b0dea086-f260-4058-b508-4103466a6296'} 01/16/2025 00:53:37.003 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4a69b518-b6c9-42d1-8405-f182a809b8f7 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.43:8082/alarm/4a69b518-b6c9-42d1-8405-f182a809b8f7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "4a69b518-b6c9-42d1-8405-f182a809b8f7", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.034 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4a69b518-b6c9-42d1-8405-f182a809b8f7 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-high url = http://10.0.0.43:8082/alarm/4a69b518-b6c9-42d1-8405-f182a809b8f7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "4a69b518-b6c9-42d1-8405-f182a809b8f7", "fq_name": ["default-global-system-config", "system-defined-disk-usage-high"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": "range", "operand2": {"json_value": "[70, 90]"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.045 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['juniper-vsrx'], 'obj_dict': {'display_name': 'juniper-vsrx', 'fq_name': ['juniper-vsrx'], 'id_perms': {'created': '2025-01-16T00:53:37.024515', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.024515', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12971260742606189138, 'uuid_mslong': 13143133783434415222}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'b665ca8a-6d0b-4c76-b403-2cebb402f252'}, 'oper': 'CREATE', 'request-id': 'req-1fa5117b-1098-43da-acbf-7138c5f70452', 'type': 'hardware', 'uuid': 'b665ca8a-6d0b-4c76-b403-2cebb402f252'} 01/16/2025 00:53:37.049 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-2f9b978f-0451-437b-9a3e-ef05ebfbe2ba', 'type': 'alarm', 'uuid': '4a69b518-b6c9-42d1-8405-f182a809b8f7'} 01/16/2025 00:53:37.070 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'oper': 'UPDATE', 'request-id': 'req-d7b155c4-73c2-4ba7-a302-16759e1808ba', 'type': 'alarm', 'uuid': '4a69b518-b6c9-42d1-8405-f182a809b8f7'} 01/16/2025 00:53:37.076 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:underlay-ip-clos url = http://10.0.0.43:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "underlay-ip-clos"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "underlay-ip-clos"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.135 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'obj_dict': {'display_name': 'underlay-ip-clos', 'fq_name': ['default-global-system-config', 'underlay-ip-clos'], 'id_perms': {'created': '2025-01-16T00:53:37.123814', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.123814', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12588006760505395145, 'uuid_mslong': 2244617037892306127}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1f267b4d-b05c-44cf-aeb1-95745e23c7c9'}, 'oper': 'CREATE', 'request-id': 'req-f707ab37-bf69-4121-aba9-a72e5cacdadb', 'type': 'feature', 'uuid': '1f267b4d-b05c-44cf-aeb1-95745e23c7c9'} 01/16/2025 00:53:37.209 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 568a0853-b843-4115-b363-8ddb80f5bcd8 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.43:8082/alarm/568a0853-b843-4115-b363-8ddb80f5bcd8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "568a0853-b843-4115-b363-8ddb80f5bcd8", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.214 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'overlay-bgp'], 'obj_dict': {'display_name': 'overlay-bgp', 'fq_name': ['default-global-system-config', 'overlay-bgp'], 'id_perms': {'created': '2025-01-16T00:53:37.200787', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.200787', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11068370017671697548, 'uuid_mslong': 11270961293009374518}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9c6a7f94-7300-4d36-999a-bfe369e7d48c'}, 'oper': 'CREATE', 'request-id': 'req-10651d13-ae0e-4f22-aac1-e88761576f0a', 'type': 'feature', 'uuid': '9c6a7f94-7300-4d36-999a-bfe369e7d48c'} 01/16/2025 00:53:37.228 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 568a0853-b843-4115-b363-8ddb80f5bcd8 object_type = alarm identifier_name = default-global-system-config:system-defined-disk-usage-critical url = http://10.0.0.43:8082/alarm/568a0853-b843-4115-b363-8ddb80f5bcd8 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "568a0853-b843-4115-b363-8ddb80f5bcd8", "fq_name": ["default-global-system-config", "system-defined-disk-usage-critical"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.disk_usage_info.*.percentage_partition_space_used", "operation": ">", "operand2": {"json_value": "90"}, "variables": ["NodeStatus.disk_usage_info.__key"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.244 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-242942a5-bb45-4fc9-907d-1d6a78ae99ae', 'type': 'alarm', 'uuid': '568a0853-b843-4115-b363-8ddb80f5bcd8'} 01/16/2025 00:53:37.266 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'oper': 'UPDATE', 'request-id': 'req-4a289180-8fa3-41f5-993e-0d166c30e1b1', 'type': 'alarm', 'uuid': '568a0853-b843-4115-b363-8ddb80f5bcd8'} 01/16/2025 00:53:37.289 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l2-gateway'], 'obj_dict': {'display_name': 'l2-gateway', 'fq_name': ['default-global-system-config', 'l2-gateway'], 'id_perms': {'created': '2025-01-16T00:53:37.278622', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.278622', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12169042828247252804, 'uuid_mslong': 2901188113639555948}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '28431737-dc12-436c-a8e1-1ffa5a313f44'}, 'oper': 'CREATE', 'request-id': 'req-f38bd14e-5100-446f-a178-cd41400a3f94', 'type': 'feature', 'uuid': '28431737-dc12-436c-a8e1-1ffa5a313f44'} 01/16/2025 00:53:37.308 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:l3-gateway url = http://10.0.0.43:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "l3-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "l3-gateway"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.361 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'fq_name': ['default-global-system-config', 'l3-gateway'], 'id_perms': {'created': '2025-01-16T00:53:37.343806', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.343806', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12403485985521610772, 'uuid_mslong': 15631151630592721342}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd8ed0197-33bf-41be-ac22-08c98f8d3014'}, 'oper': 'CREATE', 'request-id': 'req-f78a05af-67fe-45e2-9f19-38759616a41d', 'type': 'feature', 'uuid': 'd8ed0197-33bf-41be-ac22-08c98f8d3014'} 01/16/2025 00:53:37.398 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.43:8082/alarm/dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.423 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb object_type = alarm identifier_name = default-global-system-config:system-defined-node-status url = http://10.0.0.43:8082/alarm/dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb", "fq_name": ["default-global-system-config", "system-defined-node-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.425 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'vn-interconnect'], 'obj_dict': {'display_name': 'vn-interconnect', 'fq_name': ['default-global-system-config', 'vn-interconnect'], 'id_perms': {'created': '2025-01-16T00:53:37.408296', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.408296', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11360928778168335441, 'uuid_mslong': 2342091632055962799}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2080c7ee-301c-4caf-9daa-2087ed3c7c51'}, 'oper': 'CREATE', 'request-id': 'req-9e991edf-74f1-4d2d-a543-d4f9d2579726', 'type': 'feature', 'uuid': '2080c7ee-301c-4caf-9daa-2087ed3c7c51'} 01/16/2025 00:53:37.438 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-15c8dd06-f794-4cd3-b890-b31b1417368b', 'type': 'alarm', 'uuid': 'dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb'} 01/16/2025 00:53:37.493 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'oper': 'UPDATE', 'request-id': 'req-35475a29-3a78-42d2-ac97-666ab633658f', 'type': 'alarm', 'uuid': 'dc2a123d-0dc0-4ae3-ba4a-92032b8c0bfb'} 01/16/2025 00:53:37.575 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-01-16T00:53:37.542329', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.542329', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10082090358746691090, 'uuid_mslong': 12227519616408571898}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a9b0e04e-9427-4ffa-8bea-c7c39a7cb612'}, 'oper': 'CREATE', 'request-id': 'req-8376a48f-4561-4777-a837-891aba5335aa', 'type': 'feature', 'uuid': 'a9b0e04e-9427-4ffa-8bea-c7c39a7cb612'} 01/16/2025 00:53:37.623 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 23307f20-5fdc-4ef9-83c2-e5b7be4523c2 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.43:8082/alarm/23307f20-5fdc-4ef9-83c2-e5b7be4523c2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "23307f20-5fdc-4ef9-83c2-e5b7be4523c2", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.626 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:assisted-replicator url = http://10.0.0.43:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "assisted-replicator"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.662 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 23307f20-5fdc-4ef9-83c2-e5b7be4523c2 object_type = alarm identifier_name = default-global-system-config:system-defined-partial-sysinfo url = http://10.0.0.43:8082/alarm/23307f20-5fdc-4ef9-83c2-e5b7be4523c2 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "23307f20-5fdc-4ef9-83c2-e5b7be4523c2", "fq_name": ["default-global-system-config", "system-defined-partial-sysinfo"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.build_info", "operation": "==", "operand2": {"json_value": "null"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.696 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-9c923e04-5176-4963-bbe4-5d8f55cfb955', 'type': 'alarm', 'uuid': '23307f20-5fdc-4ef9-83c2-e5b7be4523c2'} 01/16/2025 00:53:37.704 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'oper': 'UPDATE', 'request-id': 'req-89948834-55b5-447f-9872-f8b5fda8e28d', 'type': 'alarm', 'uuid': '23307f20-5fdc-4ef9-83c2-e5b7be4523c2'} 01/16/2025 00:53:37.720 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'fq_name': ['default-global-system-config', 'assisted-replicator'], 'id_perms': {'created': '2025-01-16T00:53:37.699459', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.699459', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12595895819069118839, 'uuid_mslong': 3723045927149782114}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '33aaea8b-923a-4462-aecd-9c82f3715977'}, 'oper': 'CREATE', 'request-id': 'req-47b8ab7d-e236-4da1-83de-ada22a2a88cb', 'type': 'feature', 'uuid': '33aaea8b-923a-4462-aecd-9c82f3715977'} 01/16/2025 00:53:37.836 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'port-profile'], 'obj_dict': {'display_name': 'port-profile', 'fq_name': ['default-global-system-config', 'port-profile'], 'id_perms': {'created': '2025-01-16T00:53:37.808148', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.808148', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11840956752444816670, 'uuid_mslong': 18152712774968167495}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fbeb6417-75ac-4c47-a453-876e263c7d1e'}, 'oper': 'CREATE', 'request-id': 'req-02f792af-b8dc-422c-8658-7286e2621f54', 'type': 'feature', 'uuid': 'fbeb6417-75ac-4c47-a453-876e263c7d1e'} 01/16/2025 00:53:37.889 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e39b6eee-422e-47fa-afe3-8012861d494c object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.43:8082/alarm/e39b6eee-422e-47fa-afe3-8012861d494c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "e39b6eee-422e-47fa-afe3-8012861d494c", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.900 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = e39b6eee-422e-47fa-afe3-8012861d494c object_type = alarm identifier_name = default-global-system-config:system-defined-process-connectivity url = http://10.0.0.43:8082/alarm/e39b6eee-422e-47fa-afe3-8012861d494c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "e39b6eee-422e-47fa-afe3-8012861d494c", "fq_name": ["default-global-system-config", "system-defined-process-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_status", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_status.state", "operation": "!=", "operand2": {"json_value": "\"Functional\""}, "variables": ["NodeStatus.process_status.module_id", "NodeStatus.process_status.instance_id"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:37.939 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'telemetry'], 'obj_dict': {'display_name': 'telemetry', 'fq_name': ['default-global-system-config', 'telemetry'], 'id_perms': {'created': '2025-01-16T00:53:37.920741', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:37.920741', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10012644739425313987, 'uuid_mslong': 12230895451903246727}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a9bcde9c-87a2-4187-8af4-0f575ba124c3'}, 'oper': 'CREATE', 'request-id': 'req-ea32405b-dd97-4292-8e70-130cc926ca17', 'type': 'feature', 'uuid': 'a9bcde9c-87a2-4187-8af4-0f575ba124c3'} 01/16/2025 00:53:37.941 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-7c8b81a1-0a19-433a-b7e3-2cc265e900c5', 'type': 'alarm', 'uuid': 'e39b6eee-422e-47fa-afe3-8012861d494c'} 01/16/2025 00:53:37.962 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-ab56d024-c0cf-493b-9797-3c009cd5119e', 'type': 'alarm', 'uuid': 'e39b6eee-422e-47fa-afe3-8012861d494c'} 01/16/2025 00:53:37.988 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature identifier_name = default-global-system-config:firewall url = http://10.0.0.43:8082/features operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"feature": {"uuid": null, "fq_name": ["default-global-system-config", "firewall"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "firewall"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.078 7f9846ad5c18 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4b513fa7-8682-4c9a-9ac3-44c1bce7669c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.43:8082/global-vrouter-config/4b513fa7-8682-4c9a-9ac3-44c1bce7669c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.29 body = {"global-vrouter-config": {"uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.086 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'firewall'], 'obj_dict': {'display_name': 'firewall', 'fq_name': ['default-global-system-config', 'firewall'], 'id_perms': {'created': '2025-01-16T00:53:38.053560', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.053560', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10930962366973541750, 'uuid_mslong': 13151467190957392654}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b68365bb-1038-430e-97b2-945ba89efd76'}, 'oper': 'CREATE', 'request-id': 'req-d29cf887-4a7b-4d07-8cf0-beadf00288f7', 'type': 'feature', 'uuid': 'b68365bb-1038-430e-97b2-945ba89efd76'} 01/16/2025 00:53:38.119 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d73794e0-3893-4712-97a2-cdeacf35a8f7 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.43:8082/alarm/d73794e0-3893-4712-97a2-cdeacf35a8f7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "d73794e0-3893-4712-97a2-cdeacf35a8f7", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.125 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-1a2df827-c34f-42af-a6e0-daeaca9e1507', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:38.143 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d73794e0-3893-4712-97a2-cdeacf35a8f7 object_type = alarm identifier_name = default-global-system-config:system-defined-process-status url = http://10.0.0.43:8082/alarm/d73794e0-3893-4712-97a2-cdeacf35a8f7 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "d73794e0-3893-4712-97a2-cdeacf35a8f7", "fq_name": ["default-global-system-config", "system-defined-process-status"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.process_info", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "NodeStatus.process_info.process_state", "operation": "!=", "operand2": {"json_value": "\"PROCESS_STATE_RUNNING\""}, "variables": ["NodeStatus.process_info.process_name"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.177 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'infra-bms-access'], 'obj_dict': {'display_name': 'infra-bms-access', 'fq_name': ['default-global-system-config', 'infra-bms-access'], 'id_perms': {'created': '2025-01-16T00:53:38.168661', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.168661', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13226843410127798627, 'uuid_mslong': 5583909664999754908}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4d7e0841-682e-4c9c-b78f-3000b0624163'}, 'oper': 'CREATE', 'request-id': 'req-e99d9cae-09f7-4589-9532-bd4524393d74', 'type': 'feature', 'uuid': '4d7e0841-682e-4c9c-b78f-3000b0624163'} 01/16/2025 00:53:38.187 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-5334814f-41a6-4592-922b-6188e2dbffec', 'type': 'alarm', 'uuid': 'd73794e0-3893-4712-97a2-cdeacf35a8f7'} 01/16/2025 00:53:38.203 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'oper': 'UPDATE', 'request-id': 'req-2728e648-fd3c-4283-ab2e-3f36389e3734', 'type': 'alarm', 'uuid': 'd73794e0-3893-4712-97a2-cdeacf35a8f7'} 01/16/2025 00:53:38.259 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'obj_dict': {'display_name': 'pnf-service-chaining', 'fq_name': ['default-global-system-config', 'pnf-service-chaining'], 'id_perms': {'created': '2025-01-16T00:53:38.250584', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.250584', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13098195264540609911, 'uuid_mslong': 3003564848233922697}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '29aece50-ded5-4089-b5c6-233225a58d77'}, 'oper': 'CREATE', 'request-id': 'req-f6b6ceac-33f8-4719-801b-b16e650cce8e', 'type': 'feature', 'uuid': '29aece50-ded5-4089-b5c6-233225a58d77'} 01/16/2025 00:53:38.290 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:leaf url = http://10.0.0.43:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "leaf"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.326 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'leaf'], 'obj_dict': {'display_name': 'leaf', 'fq_name': ['default-global-system-config', 'leaf'], 'id_perms': {'created': '2025-01-16T00:53:38.318062', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.318062', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10317199442318705661, 'uuid_mslong': 5312330104054367531}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '49b93015-6dc6-452b-8f2e-0e3adc43c3fd'}, 'oper': 'CREATE', 'request-id': 'req-607d163b-7682-49a5-afa4-ec018320b64f', 'type': 'physical_role', 'uuid': '49b93015-6dc6-452b-8f2e-0e3adc43c3fd'} 01/16/2025 00:53:38.333 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 72375b55-cb66-4613-8d8c-58000035532f object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.43:8082/alarm/72375b55-cb66-4613-8d8c-58000035532f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "72375b55-cb66-4613-8d8c-58000035532f", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.352 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 72375b55-cb66-4613-8d8c-58000035532f object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-connectivity url = http://10.0.0.43:8082/alarm/72375b55-cb66-4613-8d8c-58000035532f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "72375b55-cb66-4613-8d8c-58000035532f", "fq_name": ["default-global-system-config", "system-defined-prouter-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.connected_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.364 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-41687de9-eedc-412c-873f-c9a9efb381fa', 'type': 'alarm', 'uuid': '72375b55-cb66-4613-8d8c-58000035532f'} 01/16/2025 00:53:38.385 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-9fbaeda3-05dd-4448-8615-9511acbed582', 'type': 'alarm', 'uuid': '72375b55-cb66-4613-8d8c-58000035532f'} 01/16/2025 00:53:38.396 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'spine'], 'obj_dict': {'display_name': 'spine', 'fq_name': ['default-global-system-config', 'spine'], 'id_perms': {'created': '2025-01-16T00:53:38.382787', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.382787', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13385136664028099039, 'uuid_mslong': 16627038488217144725}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e6bf1b69-44ee-4d95-b9c1-8ee0e173b1df'}, 'oper': 'CREATE', 'request-id': 'req-22d277f2-0d05-4de3-9246-c63e31d58aef', 'type': 'physical_role', 'uuid': 'e6bf1b69-44ee-4d95-b9c1-8ee0e173b1df'} 01/16/2025 00:53:38.466 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'superspine'], 'obj_dict': {'display_name': 'superspine', 'fq_name': ['default-global-system-config', 'superspine'], 'id_perms': {'created': '2025-01-16T00:53:38.457001', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.457001', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11580097266826975719, 'uuid_mslong': 8943200483038940535}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c1ca174-caa3-4d77-a0b4-c51c35b199e7'}, 'oper': 'CREATE', 'request-id': 'req-b40f1bfe-835d-4301-95e8-11b58782d80b', 'type': 'physical_role', 'uuid': '7c1ca174-caa3-4d77-a0b4-c51c35b199e7'} 01/16/2025 00:53:38.493 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = physical_role identifier_name = default-global-system-config:pnf url = http://10.0.0.43:8082/physical-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"physical-role": {"uuid": null, "fq_name": ["default-global-system-config", "pnf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.515 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7bbc9bdf-9890-4945-8441-d2d22f169c9a object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.43:8082/alarm/7bbc9bdf-9890-4945-8441-d2d22f169c9a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "7bbc9bdf-9890-4945-8441-d2d22f169c9a", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.540 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 7bbc9bdf-9890-4945-8441-d2d22f169c9a object_type = alarm identifier_name = default-global-system-config:system-defined-prouter-tsn-connectivity url = http://10.0.0.43:8082/alarm/7bbc9bdf-9890-4945-8441-d2d22f169c9a operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "7bbc9bdf-9890-4945-8441-d2d22f169c9a", "fq_name": ["default-global-system-config", "system-defined-prouter-tsn-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["prouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "1"}}, {"operand1": "ProuterData.gateway_mode", "operation": "!=", "operand2": {"json_value": "\"SERVER\""}}]}, {"and_list": [{"operand1": "ContrailConfig.elements.virtual_router_refs", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "ProuterData.tsn_agent_list", "operation": "size!=", "operand2": {"json_value": "0"}}, {"operand1": "ProuterData.gateway_mode", "operation": "==", "operand2": {"json_value": "\"SERVER\""}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.564 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf'], 'obj_dict': {'display_name': 'pnf', 'fq_name': ['default-global-system-config', 'pnf'], 'id_perms': {'created': '2025-01-16T00:53:38.541252', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.541252', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11598060630841816266, 'uuid_mslong': 11859160094845651705}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a4943346-13c3-4af9-a0f4-96b1d0c4f4ca'}, 'oper': 'CREATE', 'request-id': 'req-1aa9e5bf-c16b-4de3-9b34-5b784c68f320', 'type': 'physical_role', 'uuid': 'a4943346-13c3-4af9-a0f4-96b1d0c4f4ca'} 01/16/2025 00:53:38.566 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-53229312-307d-4689-b0bc-cf34cb8d0732', 'type': 'alarm', 'uuid': '7bbc9bdf-9890-4945-8441-d2d22f169c9a'} 01/16/2025 00:53:38.587 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-41dc4be8-4fde-4d6b-9187-2a32a8957eab', 'type': 'alarm', 'uuid': '7bbc9bdf-9890-4945-8441-d2d22f169c9a'} 01/16/2025 00:53:38.623 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'obj_dict': {'display_name': 'erb-ucast-gateway', 'fq_name': ['default-global-system-config', 'erb-ucast-gateway'], 'id_perms': {'created': '2025-01-16T00:53:38.610186', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.610186', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12281307651363029643, 'uuid_mslong': 15233278283709827975}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd36779e3-c132-4b87-aa6f-f83d60c7c28b'}, 'oper': 'CREATE', 'request-id': 'req-76223243-3e6e-4b32-8452-6bcf8219d8cb', 'type': 'overlay_role', 'uuid': 'd36779e3-c132-4b87-aa6f-f83d60c7c28b'} 01/16/2025 00:53:38.702 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access'], 'obj_dict': {'display_name': 'crb-access', 'fq_name': ['default-global-system-config', 'crb-access'], 'id_perms': {'created': '2025-01-16T00:53:38.691440', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.691440', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11535418796019232695, 'uuid_mslong': 18425898528769788270}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ffb5f116-5ab7-496e-a016-0a4718172fb7'}, 'oper': 'CREATE', 'request-id': 'req-5768f424-838b-4a5a-96da-53c98af56721', 'type': 'overlay_role', 'uuid': 'ffb5f116-5ab7-496e-a016-0a4718172fb7'} 01/16/2025 00:53:38.715 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e6260b-6931-4f25-9a08-2707e1671583 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.43:8082/alarm/b2e6260b-6931-4f25-9a08-2707e1671583 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "b2e6260b-6931-4f25-9a08-2707e1671583", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.728 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = http://10.0.0.43:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.749 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b2e6260b-6931-4f25-9a08-2707e1671583 object_type = alarm identifier_name = default-global-system-config:system-defined-storage-cluster-state url = http://10.0.0.43:8082/alarm/b2e6260b-6931-4f25-9a08-2707e1671583 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "b2e6260b-6931-4f25-9a08-2707e1671583", "fq_name": ["default-global-system-config", "system-defined-storage-cluster-state"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["storage-cluster"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "StorageCluster.info_stats.status", "operation": "!=", "operand2": {"json_value": "0"}, "variables": ["StorageCluster.info_stats.health_summary"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.769 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-16216592-3c28-4b1d-90ee-6e4bc8a5d5bb', 'type': 'alarm', 'uuid': 'b2e6260b-6931-4f25-9a08-2707e1671583'} 01/16/2025 00:53:38.794 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'oper': 'UPDATE', 'request-id': 'req-5bc7e277-015e-43ff-9f8e-cf285fe8e09a', 'type': 'alarm', 'uuid': 'b2e6260b-6931-4f25-9a08-2707e1671583'} 01/16/2025 00:53:38.807 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'obj_dict': {'display_name': 'crb-mcast-gateway', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'id_perms': {'created': '2025-01-16T00:53:38.790035', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.790035', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12673304157573990779, 'uuid_mslong': 12848435448018325110}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b24ecff7-4eab-4e76-afe0-9efc3aadc97b'}, 'oper': 'CREATE', 'request-id': 'req-8fbc6ebc-4ba7-4785-95b4-4752d5a725f2', 'type': 'overlay_role', 'uuid': 'b24ecff7-4eab-4e76-afe0-9efc3aadc97b'} 01/16/2025 00:53:38.871 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway'], 'obj_dict': {'display_name': 'crb-gateway', 'fq_name': ['default-global-system-config', 'crb-gateway'], 'id_perms': {'created': '2025-01-16T00:53:38.854010', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.854010', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12910825936124233277, 'uuid_mslong': 1531854190784037032}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '15423d45-3960-40a8-b32c-77c8cf95c63d'}, 'oper': 'CREATE', 'request-id': 'req-c3da0b6a-a5ff-4390-aedf-ed4d9710bcbf', 'type': 'overlay_role', 'uuid': '15423d45-3960-40a8-b32c-77c8cf95c63d'} 01/16/2025 00:53:38.959 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-01-16T00:53:38.923972', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:38.923972', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10559360105475103818, 'uuid_mslong': 18214448711007029999}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'fcc6b899-2f25-4aef-928a-6211ee465c4a'}, 'oper': 'CREATE', 'request-id': 'req-db3e2efe-adf6-40a0-b250-f5b562972ce5', 'type': 'overlay_role', 'uuid': 'fcc6b899-2f25-4aef-928a-6211ee465c4a'} 01/16/2025 00:53:38.964 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37c6494f-8df8-4c14-b4b5-9136b3654563 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.43:8082/alarm/37c6494f-8df8-4c14-b4b5-9136b3654563 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "37c6494f-8df8-4c14-b4b5-9136b3654563", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.970 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b24ecff7-4eab-4e76-afe0-9efc3aadc97b object_type = overlay_role identifier_name = default-global-system-config:crb-mcast-gateway url = http://10.0.0.43:8082/overlay-role/b24ecff7-4eab-4e76-afe0-9efc3aadc97b operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"overlay-role": {"uuid": "b24ecff7-4eab-4e76-afe0-9efc3aadc97b", "fq_name": ["default-global-system-config", "crb-mcast-gateway"], "parent_type": "global-system-config"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:38.973 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 37c6494f-8df8-4c14-b4b5-9136b3654563 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-interface url = http://10.0.0.43:8082/alarm/37c6494f-8df8-4c14-b4b5-9136b3654563 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "37c6494f-8df8-4c14-b4b5-9136b3654563", "fq_name": ["default-global-system-config", "system-defined-vrouter-interface"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.down_interface_count", "operation": ">=", "operand2": {"json_value": "1"}, "variables": ["VrouterAgent.error_intf_list", "VrouterAgent.no_config_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.031 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway'], 'oper': 'UPDATE', 'request-id': 'req-d5509aa2-b9e8-4847-baa1-eaf6c9dcab77', 'type': 'overlay_role', 'uuid': 'b24ecff7-4eab-4e76-afe0-9efc3aadc97b'} 01/16/2025 00:53:39.047 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-da47862d-bf79-4ace-8767-fb588b9e04b2', 'type': 'alarm', 'uuid': '37c6494f-8df8-4c14-b4b5-9136b3654563'} 01/16/2025 00:53:39.063 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'oper': 'UPDATE', 'request-id': 'req-919dde64-f168-46cf-92a6-999b306b5ef3', 'type': 'alarm', 'uuid': '37c6494f-8df8-4c14-b4b5-9136b3654563'} 01/16/2025 00:53:39.108 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway'], 'obj_dict': {'display_name': 'dc-gateway', 'fq_name': ['default-global-system-config', 'dc-gateway'], 'id_perms': {'created': '2025-01-16T00:53:39.078780', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.078780', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9387714263974233162, 'uuid_mslong': 13646387552211192732}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bd61b52d-54dc-4b9c-8247-dc62850d444a'}, 'oper': 'CREATE', 'request-id': 'req-2be9be31-ce6f-41b2-80b5-a3fcd1969d58', 'type': 'overlay_role', 'uuid': 'bd61b52d-54dc-4b9c-8247-dc62850d444a'} 01/16/2025 00:53:39.122 7f9844f25048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4b513fa7-8682-4c9a-9ac3-44c1bce7669c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.43:8082/global-vrouter-config/4b513fa7-8682-4c9a-9ac3-44c1bce7669c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.29 body = {"global-vrouter-config": {"uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.143 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-5a7b74b3-3612-4e84-b3ec-17fe6e2254b8', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:39.174 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway'], 'obj_dict': {'display_name': 'dci-gateway', 'fq_name': ['default-global-system-config', 'dci-gateway'], 'id_perms': {'created': '2025-01-16T00:53:39.151588', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.151588', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11960335598685555166, 'uuid_mslong': 16621391699146592207}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e6ab0baf-bc42-4fcf-a5fb-a5dbc21c89de'}, 'oper': 'CREATE', 'request-id': 'req-4f6a30dd-2d65-4c57-8cc9-c9ea788cd012', 'type': 'overlay_role', 'uuid': 'e6ab0baf-bc42-4fcf-a5fb-a5dbc21c89de'} 01/16/2025 00:53:39.190 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:ar-client url = http://10.0.0.43:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.244 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.43:8082/alarm/5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.247 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07 object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-connectivity url = http://10.0.0.43:8082/alarm/5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07", "fq_name": ["default-global-system-config", "system-defined-xmpp-connectivity"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["control-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "==", "operand2": {"json_value": "null"}}]}, {"and_list": [{"operand1": "BgpRouterState.num_up_xmpp_peer", "operation": "!=", "operand2": {"uve_attribute": "BgpRouterState.num_xmpp_peer"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.267 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client'], 'obj_dict': {'display_name': 'ar-client', 'fq_name': ['default-global-system-config', 'ar-client'], 'id_perms': {'created': '2025-01-16T00:53:39.220821', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.220821', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11736524970260870430, 'uuid_mslong': 12821340810995911194}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b1ee8d89-87a1-4a1a-a2e0-834715e6b51e'}, 'oper': 'CREATE', 'request-id': 'req-f82cb4a1-2146-4ea0-bfd5-4ed7e1e94097', 'type': 'overlay_role', 'uuid': 'b1ee8d89-87a1-4a1a-a2e0-834715e6b51e'} 01/16/2025 00:53:39.295 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-818f7a92-82f8-4a2d-b791-8593e4f39b36', 'type': 'alarm', 'uuid': '5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07'} 01/16/2025 00:53:39.307 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator'], 'obj_dict': {'display_name': 'ar-replicator', 'fq_name': ['default-global-system-config', 'ar-replicator'], 'id_perms': {'created': '2025-01-16T00:53:39.294437', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.294437', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9245704463031639900, 'uuid_mslong': 8449292002143519733}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7541ea4f-4750-43f5-804f-5739293e9f5c'}, 'oper': 'CREATE', 'request-id': 'req-63b5907b-0d5b-4a2f-ad5c-58697fd3d16f', 'type': 'overlay_role', 'uuid': '7541ea4f-4750-43f5-804f-5739293e9f5c'} 01/16/2025 00:53:39.308 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'oper': 'UPDATE', 'request-id': 'req-b5269efd-ae6e-43f8-8962-198025c91e97', 'type': 'alarm', 'uuid': '5792fdcc-f1d4-467f-9a4e-7b22c7d0dd07'} 01/16/2025 00:53:39.370 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'route-reflector'], 'obj_dict': {'display_name': 'route-reflector', 'fq_name': ['default-global-system-config', 'route-reflector'], 'id_perms': {'created': '2025-01-16T00:53:39.359622', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.359622', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12426342563022256131, 'uuid_mslong': 14869905613737773151}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ce5c845f-1e6d-485f-ac73-3cb936423803'}, 'oper': 'CREATE', 'request-id': 'req-d9f63f4e-fdfb-40f9-83b1-13bf23cc698b', 'type': 'overlay_role', 'uuid': 'ce5c845f-1e6d-485f-ac73-3cb936423803'} 01/16/2025 00:53:39.401 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = overlay_role identifier_name = default-global-system-config:lean url = http://10.0.0.43:8082/overlay-roles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"overlay-role": {"uuid": null, "fq_name": ["default-global-system-config", "lean"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.448 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean'], 'obj_dict': {'display_name': 'lean', 'fq_name': ['default-global-system-config', 'lean'], 'id_perms': {'created': '2025-01-16T00:53:39.435423', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.435423', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11827177472574301511, 'uuid_mslong': 4647891944600915421}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4080a119-1856-4ddd-a422-933f8c4b2547'}, 'oper': 'CREATE', 'request-id': 'req-b67ac04d-15f3-4fb6-ac8e-7f22f1011607', 'type': 'overlay_role', 'uuid': '4080a119-1856-4ddd-a422-933f8c4b2547'} 01/16/2025 00:53:39.463 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c2c013a-27f4-4ca8-b6bd-716ac4030f5f object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.43:8082/alarm/2c2c013a-27f4-4ca8-b6bd-716ac4030f5f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "2c2c013a-27f4-4ca8-b6bd-716ac4030f5f", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.477 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 2c2c013a-27f4-4ca8-b6bd-716ac4030f5f object_type = alarm identifier_name = default-global-system-config:system-defined-xmpp-close-reason url = http://10.0.0.43:8082/alarm/2c2c013a-27f4-4ca8-b6bd-716ac4030f5f operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "2c2c013a-27f4-4ca8-b6bd-716ac4030f5f", "fq_name": ["default-global-system-config", "system-defined-xmpp-close-reason"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["xmpp-peer"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "XmppPeerInfoData.close_reason", "operation": "!=", "operand2": {"json_value": "null"}}, {"operand1": "XmppPeerInfoData.state_info.state", "operation": "!=", "operand2": {"json_value": "\"Established\""}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.486 7f984501af60 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:39.489 7f984501af60 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:39.489 7f984501af60 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:39.490 7f984501af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:39.490 7f984501af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:39.490 7f984501af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:39.490 7f984501af60 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:39.490 7f984501af60 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:39.491 7f984501af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:39.491 7f984501af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:39.491 7f984501af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:39.491 7f984501af60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:39.491 7f984501af60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:39.491 7f984501af60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:39.506 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-37577bf8-b392-4d50-983a-d8d883af1c55', 'type': 'alarm', 'uuid': '2c2c013a-27f4-4ca8-b6bd-716ac4030f5f'} 01/16/2025 00:53:39.510 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'oper': 'UPDATE', 'request-id': 'req-df60f6e1-fb14-4263-8f5d-13f248781b98', 'type': 'alarm', 'uuid': '2c2c013a-27f4-4ca8-b6bd-716ac4030f5f'} 01/16/2025 00:53:39.525 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'obj_dict': {'display_name': 'pnf-servicechain', 'fq_name': ['default-global-system-config', 'pnf-servicechain'], 'id_perms': {'created': '2025-01-16T00:53:39.512739', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.512739', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10753684450861188724, 'uuid_mslong': 2811086945770622190}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2702fcae-f365-4cee-953c-c30858390674'}, 'oper': 'CREATE', 'request-id': 'req-36cca775-393f-4965-a20b-02b51e7e0881', 'type': 'overlay_role', 'uuid': '2702fcae-f365-4cee-953c-c30858390674'} 01/16/2025 00:53:39.597 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'obj_dict': {'display_name': 'erb-leaf', 'fq_name': ['default-global-system-config', 'erb-leaf'], 'id_perms': {'created': '2025-01-16T00:53:39.583712', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.583712', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12251731770449122136, 'uuid_mslong': 8057877206866610635}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'}, 'oper': 'CREATE', 'request-id': 'req-de05b2dc-4160-4ab9-aca8-99ef2a32f202', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:39.632 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-access-leaf url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-access-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-access-leaf"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.676 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d7fe312d-e32c-45ca-a019-ed53a7e6986e object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.43:8082/alarm/d7fe312d-e32c-45ca-a019-ed53a7e6986e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "d7fe312d-e32c-45ca-a019-ed53a7e6986e", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.677 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = d7fe312d-e32c-45ca-a019-ed53a7e6986e object_type = alarm identifier_name = default-global-system-config:system-defined-core-files url = http://10.0.0.43:8082/alarm/d7fe312d-e32c-45ca-a019-ed53a7e6986e operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "d7fe312d-e32c-45ca-a019-ed53a7e6986e", "fq_name": ["default-global-system-config", "system-defined-core-files"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "null"}, "operation": "!="}, {"operand1": "NodeStatus.all_core_file_list", "operand2": {"json_value": "0"}, "operation": "size!="}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.682 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'obj_dict': {'display_name': 'crb-access-leaf', 'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'id_perms': {'created': '2025-01-16T00:53:39.659202', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.659202', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9969563161409704959, 'uuid_mslong': 15752813739386096471}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'}, 'oper': 'CREATE', 'request-id': 'req-3eb38adf-512e-429d-a8d3-fff976a275d4', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:39.713 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-15fdd513-e23e-4534-80da-18d8ea44433a', 'type': 'alarm', 'uuid': 'd7fe312d-e32c-45ca-a019-ed53a7e6986e'} 01/16/2025 00:53:39.718 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'oper': 'UPDATE', 'request-id': 'req-9a8cfccd-9978-472b-a2d4-500a3f9775cf', 'type': 'alarm', 'uuid': 'd7fe312d-e32c-45ca-a019-ed53a7e6986e'} 01/16/2025 00:53:39.785 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'obj_dict': {'display_name': 'crb-access-spine', 'fq_name': ['default-global-system-config', 'crb-access-spine'], 'id_perms': {'created': '2025-01-16T00:53:39.758026', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.758026', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12672206009954905623, 'uuid_mslong': 16924785023547229807}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'}, 'oper': 'CREATE', 'request-id': 'req-b060f169-2bf0-48af-a027-ab88e915e711', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:39.858 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'obj_dict': {'display_name': 'crb-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'id_perms': {'created': '2025-01-16T00:53:39.843332', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.843332', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12421245406195739263, 'uuid_mslong': 11821582351120681959}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'}, 'oper': 'CREATE', 'request-id': 'req-e194dafc-0efc-4a36-a6b5-16c74863a0d7', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:39.873 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0b7222a-c4d3-4f61-836b-f444e3ab7b4d object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.43:8082/alarm/f0b7222a-c4d3-4f61-836b-f444e3ab7b4d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "f0b7222a-c4d3-4f61-836b-f444e3ab7b4d", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.888 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = f0b7222a-c4d3-4f61-836b-f444e3ab7b4d object_type = alarm identifier_name = default-global-system-config:system-defined-pending-cassandra-compaction-tasks url = http://10.0.0.43:8082/alarm/f0b7222a-c4d3-4f61-836b-f444e3ab7b4d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "f0b7222a-c4d3-4f61-836b-f444e3ab7b4d", "fq_name": ["default-global-system-config", "system-defined-pending-cassandra-compaction-tasks"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["database-nodeconfig-database-node"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks", "operand2": {"json_value": "300"}, "operation": ">="}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.891 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:crb-mcast-gateway-spine url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "crb-mcast-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "crb-mcast-gateway-spine"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:39.921 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-ba994dba-8ac5-483d-993f-8c05dac2dde9', 'type': 'alarm', 'uuid': 'f0b7222a-c4d3-4f61-836b-f444e3ab7b4d'} 01/16/2025 00:53:39.931 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'oper': 'UPDATE', 'request-id': 'req-1c7caa2d-b9b3-406a-a20e-6d99c36b515e', 'type': 'alarm', 'uuid': 'f0b7222a-c4d3-4f61-836b-f444e3ab7b4d'} 01/16/2025 00:53:39.953 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'obj_dict': {'display_name': 'crb-mcast-gateway-spine', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'id_perms': {'created': '2025-01-16T00:53:39.940758', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:39.940758', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11630824494588073178, 'uuid_mslong': 7997163973309843391}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'}, 'oper': 'CREATE', 'request-id': 'req-020238b2-8559-429b-8073-6f8eb5bdd905', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:40.025 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'obj_dict': {'display_name': 'collapsed-spine', 'fq_name': ['default-global-system-config', 'collapsed-spine'], 'id_perms': {'created': '2025-01-16T00:53:40.001397', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.001397', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10531498473418297891, 'uuid_mslong': 13816753906316365769}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'}, 'oper': 'CREATE', 'request-id': 'req-827c729e-8410-4861-8aa9-77c202271dcf', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:53:40.083 7f9844f3a048 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/global-system-config/22978d74-648d-4342-9707-c760fd7f98ed operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.29 body = {"global-system-config": {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.086 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6513ae64-2112-4de3-b699-36aa9c9129bc object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.43:8082/alarm/6513ae64-2112-4de3-b699-36aa9c9129bc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "6513ae64-2112-4de3-b699-36aa9c9129bc", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.093 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'obj_dict': {'display_name': 'dc-gateway-spine', 'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'id_perms': {'created': '2025-01-16T00:53:40.078082', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.078082', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12348431418616536460, 'uuid_mslong': 4088728594196088524}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'}, 'oper': 'CREATE', 'request-id': 'req-20b8c11c-d134-4079-b575-777ec5220099', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:40.103 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 6513ae64-2112-4de3-b699-36aa9c9129bc object_type = alarm identifier_name = default-global-system-config:system-defined-package-version-mismatch url = http://10.0.0.43:8082/alarm/6513ae64-2112-4de3-b699-36aa9c9129bc operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "6513ae64-2112-4de3-b699-36aa9c9129bc", "fq_name": ["default-global-system-config", "system-defined-package-version-mismatch"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["analytics-node", "analytics-alarm-node", "analytics-snmp-node", "config-node", "control-node", "database-node", "config-database-node", "vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "NodeStatus.running_package_version", "operation": "!=", "operand2": {"uve_attribute": "NodeStatus.installed_package_version"}}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.126 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dci-gateway-spine url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dci-gateway-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dci-gateway-spine"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.144 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-bfcfffbe-e5f2-48b1-a1fd-6a68d125f6fc', 'type': 'alarm', 'uuid': '6513ae64-2112-4de3-b699-36aa9c9129bc'} 01/16/2025 00:53:40.164 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-69ee2f96-f9d0-4d1c-9900-fcf25b88f7d4', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:53:40.171 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'oper': 'UPDATE', 'request-id': 'req-e389375d-9832-46b2-b449-9d5cea5a33e7', 'type': 'alarm', 'uuid': '6513ae64-2112-4de3-b699-36aa9c9129bc'} 01/16/2025 00:53:40.227 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'obj_dict': {'display_name': 'dci-gateway-spine', 'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'id_perms': {'created': '2025-01-16T00:53:40.208834', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.208834', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12193088755420939836, 'uuid_mslong': 10012589225615839172}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'}, 'oper': 'CREATE', 'request-id': 'req-eeefd0ef-fda0-42c2-90f3-0692b576fb64', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:40.306 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3dc85f82-e79c-4cff-97c7-3372556425fa object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.43:8082/alarm/3dc85f82-e79c-4cff-97c7-3372556425fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "3dc85f82-e79c-4cff-97c7-3372556425fa", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.314 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'obj_dict': {'display_name': 'crb-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.303406', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.303406', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11628149151551665567, 'uuid_mslong': 8628064646949456553}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'}, 'oper': 'CREATE', 'request-id': 'req-274c3f78-161a-4ad6-a05f-cb4d9075a78f', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:40.339 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 3dc85f82-e79c-4cff-97c7-3372556425fa object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-limit-exceeded url = http://10.0.0.43:8082/alarm/3dc85f82-e79c-4cff-97c7-3372556425fa operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "3dc85f82-e79c-4cff-97c7-3372556425fa", "fq_name": ["default-global-system-config", "system-defined-vrouter-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 1, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.372 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-af98f228-0a25-4629-a27f-c51261b58dd9', 'type': 'alarm', 'uuid': '3dc85f82-e79c-4cff-97c7-3372556425fa'} 01/16/2025 00:53:40.388 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-655f005d-ec56-4081-833c-3b50f706ab81', 'type': 'alarm', 'uuid': '3dc85f82-e79c-4cff-97c7-3372556425fa'} 01/16/2025 00:53:40.413 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'obj_dict': {'display_name': 'crb-mcast-gateway-leaf', 'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.399458', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.399458', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13223210503622150333, 'uuid_mslong': 8989398909569614009}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'}, 'oper': 'CREATE', 'request-id': 'req-f21fc23c-9c3a-414d-b63c-aae2737828e2', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:40.431 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:dc-gateway-leaf url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "dc-gateway-leaf"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "dc-gateway-leaf"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.463 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'obj_dict': {'display_name': 'dc-gateway-leaf', 'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.455315', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.455315', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11479725191833923605, 'uuid_mslong': 9491129559247832468}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'}, 'oper': 'CREATE', 'request-id': 'req-45b28814-9a35-42cd-a509-13d49ad4a9eb', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:40.520 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'obj_dict': {'display_name': 'dci-gateway-leaf', 'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.512414', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.512414', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9774888165791784795, 'uuid_mslong': 17755330707258886168}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'}, 'oper': 'CREATE', 'request-id': 'req-421f7407-e2e4-4e49-95f4-57fca21a0998', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:40.525 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0baae21f-aa1a-4013-a6e6-f3b59a99c5b4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.43:8082/alarm/0baae21f-aa1a-4013-a6e6-f3b59a99c5b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "0baae21f-aa1a-4013-a6e6-f3b59a99c5b4", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.537 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 0baae21f-aa1a-4013-a6e6-f3b59a99c5b4 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-table-limit-exceeded url = http://10.0.0.43:8082/alarm/0baae21f-aa1a-4013-a6e6-f3b59a99c5b4 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "0baae21f-aa1a-4013-a6e6-f3b59a99c5b4", "fq_name": ["default-global-system-config", "system-defined-vrouter-table-limit-exceeded"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.res_table_limit", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_limit_exceeded_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.553 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-069baf8d-48c3-4e59-87e0-7337daa07ff8', 'type': 'alarm', 'uuid': '0baae21f-aa1a-4013-a6e6-f3b59a99c5b4'} 01/16/2025 00:53:40.558 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'oper': 'UPDATE', 'request-id': 'req-ab4ebfb7-5c7a-4eba-898b-8a4d2394f6b4', 'type': 'alarm', 'uuid': '0baae21f-aa1a-4013-a6e6-f3b59a99c5b4'} 01/16/2025 00:53:40.584 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'obj_dict': {'display_name': 'ar-client-leaf', 'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.575711', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.575711', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12009316283766244676, 'uuid_mslong': 12664221587550194583}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'}, 'oper': 'CREATE', 'request-id': 'req-4d9b745a-8046-4fc7-a4ae-24edf5901d1d', 'type': 'role_definition', 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'} 01/16/2025 00:53:40.610 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:ar-client-spine url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "ar-client-spine"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.646 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'obj_dict': {'display_name': 'ar-client-spine', 'fq_name': ['default-global-system-config', 'ar-client-spine'], 'id_perms': {'created': '2025-01-16T00:53:40.635495', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.635495', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11429725781556907354, 'uuid_mslong': 1083836429164759085}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'}, 'oper': 'CREATE', 'request-id': 'req-51071d20-d050-4a80-94bf-a935a345e6c6', 'type': 'role_definition', 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'} 01/16/2025 00:53:40.702 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'obj_dict': {'display_name': 'ar-replicator-leaf', 'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.694110', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.694110', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13547053062051121906, 'uuid_mslong': 3417523228626799631}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'}, 'oper': 'CREATE', 'request-id': 'req-c6234ff8-2242-433d-84da-97369860ea79', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:40.709 7f9844f39828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b0dea086-f260-4058-b508-4103466a6296 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.43:8082/alarm/b0dea086-f260-4058-b508-4103466a6296 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.43 body = {"alarm": {"uuid": "b0dea086-f260-4058-b508-4103466a6296", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.715 7f9844f390f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = b0dea086-f260-4058-b508-4103466a6296 object_type = alarm identifier_name = default-global-system-config:system-defined-vrouter-l3mh-physical-interface-link-down url = http://10.0.0.43:8082/alarm/b0dea086-f260-4058-b508-4103466a6296 operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_alarm.py remote_ip = 10.0.0.23 body = {"alarm": {"uuid": "b0dea086-f260-4058-b508-4103466a6296", "fq_name": ["default-global-system-config", "system-defined-vrouter-l3mh-physical-interface-link-down"], "parent_type": "global-system-config", "uve_keys": {"uve_key": ["vrouter"]}, "alarm_severity": 0, "alarm_rules": {"or_list": [{"and_list": [{"operand1": "VrouterAgent.l3mh_phy_interface_down", "operation": "==", "operand2": {"json_value": "true"}, "variables": ["VrouterAgent.vr_l3mh_intf_list"]}]}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.736 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-fb4ed03b-1e6d-46e4-be5e-8670ebf78f55', 'type': 'alarm', 'uuid': 'b0dea086-f260-4058-b508-4103466a6296'} 01/16/2025 00:53:40.739 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'oper': 'UPDATE', 'request-id': 'req-c02614d3-690e-4120-945c-27e787609915', 'type': 'alarm', 'uuid': 'b0dea086-f260-4058-b508-4103466a6296'} 01/16/2025 00:53:40.776 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'obj_dict': {'display_name': 'ar-replicator-spine', 'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'id_perms': {'created': '2025-01-16T00:53:40.766871', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.766871', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11981542715296970340, 'uuid_mslong': 2353180385808238087}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'}, 'oper': 'CREATE', 'request-id': 'req-fc0830b8-e6b1-4d19-8245-6d35884955b1', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:40.815 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:rr-spine url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "rr-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "rr-spine"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:40.860 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'obj_dict': {'display_name': 'rr-spine', 'fq_name': ['default-global-system-config', 'rr-spine'], 'id_perms': {'created': '2025-01-16T00:53:40.849369', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.849369', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10461810848389911106, 'uuid_mslong': 1640278103141206308}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'}, 'oper': 'CREATE', 'request-id': 'req-fbf8d599-38b6-4ad7-8529-0d5b5d26b852', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:40.928 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'obj_dict': {'display_name': 'rr-superspine', 'fq_name': ['default-global-system-config', 'rr-superspine'], 'id_perms': {'created': '2025-01-16T00:53:40.916210', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.916210', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11941740291946078303, 'uuid_mslong': 1803140786320066435}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'}, 'oper': 'CREATE', 'request-id': 'req-fde12053-0075-4105-a7cd-2f90c60a8e2d', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:40.992 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'obj_dict': {'display_name': 'rr-leaf', 'fq_name': ['default-global-system-config', 'rr-leaf'], 'id_perms': {'created': '2025-01-16T00:53:40.982804', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:40.982804', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10879338010161589886, 'uuid_mslong': 1655380294859702638}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'}, 'oper': 'CREATE', 'request-id': 'req-2e7b6b9b-47e3-42e6-ae7a-37be6ac3861e', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:41.018 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:lean-spine url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "lean-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "lean-spine"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:41.066 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'obj_dict': {'display_name': 'lean-spine', 'fq_name': ['default-global-system-config', 'lean-spine'], 'id_perms': {'created': '2025-01-16T00:53:41.055234', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.055234', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13184109019432393556, 'uuid_mslong': 9137010536175979337}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'}, 'oper': 'CREATE', 'request-id': 'req-e91826c0-acae-4c8d-9f0f-bc92e1e6b15d', 'type': 'role_definition', 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'} 01/16/2025 00:53:41.135 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'obj_dict': {'display_name': 'lean-superspine', 'fq_name': ['default-global-system-config', 'lean-superspine'], 'id_perms': {'created': '2025-01-16T00:53:41.120652', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.120652', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10390812019126640737, 'uuid_mslong': 13034297817794235903}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'}, 'oper': 'CREATE', 'request-id': 'req-bfc70c17-2171-47b5-bd3e-3a818780b067', 'type': 'role_definition', 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'} 01/16/2025 00:53:41.237 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'obj_dict': {'display_name': 'pnf-servicechain-pnf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'id_perms': {'created': '2025-01-16T00:53:41.219358', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.219358', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12693304986686913055, 'uuid_mslong': 10048803433836924869}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8b74857b-7393-4fc5-b027-ada2252afa1f'}, 'oper': 'CREATE', 'request-id': 'req-3c9dceb3-4d48-47d6-ae03-decab1ef7dc5', 'type': 'role_definition', 'uuid': '8b74857b-7393-4fc5-b027-ada2252afa1f'} 01/16/2025 00:53:41.255 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_definition identifier_name = default-global-system-config:pnf-servicechain-spine url = http://10.0.0.43:8082/role-definitions operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-definition": {"uuid": null, "fq_name": ["default-global-system-config", "pnf-servicechain-spine"], "parent_type": "global-system-config", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "pnf-servicechain-spine"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:41.299 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'obj_dict': {'display_name': 'pnf-servicechain-spine', 'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'id_perms': {'created': '2025-01-16T00:53:41.289962', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.289962', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11375252267597820196, 'uuid_mslong': 6912283724644699920}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5fed5d6c-ba29-4f10-9ddd-03ab309ff124'}, 'oper': 'CREATE', 'request-id': 'req-a53fd4de-deb0-490c-8f3a-b53c1376bde4', 'type': 'role_definition', 'uuid': '5fed5d6c-ba29-4f10-9ddd-03ab309ff124'} 01/16/2025 00:53:41.376 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'obj_dict': {'display_name': 'pnf-servicechain-leaf', 'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'id_perms': {'created': '2025-01-16T00:53:41.366207', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.366207', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11547464419025820902, 'uuid_mslong': 16647878174149986666}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e70924fe-c230-496a-a040-d5b5407f1ce6'}, 'oper': 'CREATE', 'request-id': 'req-a3b9f4cc-e52a-47a6-960c-b9ed87c80428', 'type': 'role_definition', 'uuid': 'e70924fe-c230-496a-a040-d5b5407f1ce6'} 01/16/2025 00:53:41.479 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'obj_dict': {'display_name': 'l3-gateway', 'feature_config_additional_params': {'key_value_pair': [{'key': 'use_gateway_ip', 'value': 'True'}]}, 'fq_name': ['default-global-system-config', 'erb-leaf', 'l3-gateway'], 'id_perms': {'created': '2025-01-16T00:53:41.464869', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.464869', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11145170710594640039, 'uuid_mslong': 6487125161937225902}}, 'parent_type': 'role-definition', 'parent_uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5a06e5f6-eac4-48ae-9aab-99b62e14d8a7'}, 'oper': 'CREATE', 'request-id': 'req-3845b821-db64-45f8-b84c-22a8662d2930', 'type': 'feature_config', 'uuid': '5a06e5f6-eac4-48ae-9aab-99b62e14d8a7'} 01/16/2025 00:53:41.525 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = feature_config identifier_name = default-global-system-config:ar-client-spine:assisted-replicator url = http://10.0.0.43:8082/feature-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"feature-config": {"uuid": null, "fq_name": ["default-global-system-config", "ar-client-spine", "assisted-replicator"], "parent_type": "role-definition", "feature_config_additional_params": {"key_value_pair": [{"key": "replicator_activation_delay", "value": "30"}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "assisted-replicator"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:41.598 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-spine', 'assisted-replicator'], 'id_perms': {'created': '2025-01-16T00:53:41.572320', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.572320', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13256455586594134986, 'uuid_mslong': 13532678656750275424}}, 'parent_type': 'role-definition', 'parent_uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'bbcdbb8a-031c-4b60-b7f8-641ecbaf9bca'}, 'oper': 'CREATE', 'request-id': 'req-ee47c708-3c2b-4d28-89eb-c77b1cc396b3', 'type': 'feature_config', 'uuid': 'bbcdbb8a-031c-4b60-b7f8-641ecbaf9bca'} 01/16/2025 00:53:41.689 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'obj_dict': {'display_name': 'assisted-replicator', 'feature_config_additional_params': {'key_value_pair': [{'key': 'replicator_activation_delay', 'value': '30'}]}, 'fq_name': ['default-global-system-config', 'ar-client-leaf', 'assisted-replicator'], 'id_perms': {'created': '2025-01-16T00:53:41.665955', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.665955', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12838811730039853617, 'uuid_mslong': 6935531515041235793}}, 'parent_type': 'role-definition', 'parent_uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '603ff52a-ba8f-4351-b22c-9f3edb24d231'}, 'oper': 'CREATE', 'request-id': 'req-335ad4f1-c310-4482-abfd-43afd579f64f', 'type': 'feature_config', 'uuid': '603ff52a-ba8f-4351-b22c-9f3edb24d231'} 01/16/2025 00:53:41.790 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'obj_dict': {'display_name': 'juniper-qfx5k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'id_perms': {'created': '2025-01-16T00:53:41.774700', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.774700', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13333042924409758492, 'uuid_mslong': 6246337491315671103}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'}, 'oper': 'CREATE', 'request-id': 'req-60b7302a-eef2-487b-8a74-6090db2c0a89', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:53:41.828 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5k url = http://10.0.0.43:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "leaf", "rb_roles": ["CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "ERB-UCAST-Gateway", "DCI-Gateway", "PNF-Servicechain", "AR-Client"]}, {"physical_role": "spine", "rb_roles": ["lean", "CRB-Access", "CRB-Gateway", "DC-Gateway", "Route-Reflector", "DCI-Gateway", "PNF-Servicechain", "AR-Client"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5k"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:41.874 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'obj_dict': {'display_name': 'juniper-qfx5k', 'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'id_perms': {'created': '2025-01-16T00:53:41.861589', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.861589', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12996891880880160268, 'uuid_mslong': 799210973552394822}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'}, 'oper': 'CREATE', 'request-id': 'req-e9bf3015-f701-4e33-813d-d6812459e798', 'type': 'node_profile', 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'} 01/16/2025 00:53:41.954 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'obj_dict': {'display_name': 'juniper-qfx10k-lean', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'id_perms': {'created': '2025-01-16T00:53:41.942757', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:41.942757', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10766299978100793413, 'uuid_mslong': 15243621356317066886}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['Route-Reflector', 'AR-Client']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd38c38dc-01d6-4686-9569-94c9abfe6045'}, 'oper': 'CREATE', 'request-id': 'req-fb747293-51d9-40ad-b2c7-f93b5c01a579', 'type': 'node_profile', 'uuid': 'd38c38dc-01d6-4686-9569-94c9abfe6045'} 01/16/2025 00:53:41.986 7f9844de0198 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4b513fa7-8682-4c9a-9ac3-44c1bce7669c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.43:8082/global-vrouter-config/4b513fa7-8682-4c9a-9ac3-44c1bce7669c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.23 body = {"global-vrouter-config": {"uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:42.008 7f9844fcb630 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4b513fa7-8682-4c9a-9ac3-44c1bce7669c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.43:8082/global-vrouter-config/4b513fa7-8682-4c9a-9ac3-44c1bce7669c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_encap.py remote_ip = 10.0.0.43 body = {"global-vrouter-config": {"uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "encapsulation_priorities": {"encapsulation": ["MPLSoUDP", "MPLSoGRE", "VXLAN"]}, "vxlan_network_identifier_mode": "automatic"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:42.012 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-ee7ed919-0cd0-43c1-bcbf-13b570b6d8a6', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:42.032 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-66a74fcc-4d23-4ea6-bced-60ecec8c7812', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:42.039 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'obj_dict': {'display_name': 'juniper-qfx5120', 'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'id_perms': {'created': '2025-01-16T00:53:42.022110', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.022110', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10984653520471482871, 'uuid_mslong': 16299803847904413886}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'Route-Reflector', 'AR-Client', 'ERB-UCAST-Gateway', 'CRB-Gateway', 'PNF-Servicechain']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'Route-Reflector', 'PNF-Servicechain', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e234893d-56e3-48be-9871-542d7c7261f7'}, 'oper': 'CREATE', 'request-id': 'req-17ca5f57-4f20-480b-81f1-e235ff2eb24e', 'type': 'node_profile', 'uuid': 'e234893d-56e3-48be-9871-542d7c7261f7'} 01/16/2025 00:53:42.063 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-qfx5220 url = http://10.0.0.43:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos-qfx", "node_profile_hitless_upgrade": true, "node_profile_roles": {"role_mappings": [{"physical_role": "spine", "rb_roles": ["lean", "Route-Reflector"]}, {"physical_role": "superspine", "rb_roles": ["lean", "Route-Reflector"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-qfx5220"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:42.104 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'obj_dict': {'display_name': 'juniper-qfx5220', 'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'id_perms': {'created': '2025-01-16T00:53:42.094307', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.094307', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11248651020781684990, 'uuid_mslong': 9022883399835142623}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'spine', 'rb_roles': ['lean', 'Route-Reflector']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7d37b8a5-98f1-49df-9c1b-3c81680708fe'}, 'oper': 'CREATE', 'request-id': 'req-08ea8d40-bd10-4a04-882f-fd8ba96e1afd', 'type': 'node_profile', 'uuid': '7d37b8a5-98f1-49df-9c1b-3c81680708fe'} 01/16/2025 00:53:42.163 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'obj_dict': {'display_name': 'juniper-qfx10k', 'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'id_perms': {'created': '2025-01-16T00:53:42.149059', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.149059', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12658624509978139081, 'uuid_mslong': 9574011177026404761}}, 'node_profile_device_family': 'junos-qfx', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator', 'Collapsed-Spine']}, {'physical_role': 'superspine', 'rb_roles': ['lean', 'Route-Reflector']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'}, 'oper': 'CREATE', 'request-id': 'req-765b1944-3168-4d92-91c7-f1610cc3415c', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:53:42.240 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'obj_dict': {'display_name': 'juniper-mx', 'fq_name': ['default-global-system-config', 'juniper-mx'], 'id_perms': {'created': '2025-01-16T00:53:42.222448', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.222448', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12993927955861681559, 'uuid_mslong': 6848955706918063240}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': True, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'DCI-Gateway', 'CRB-MCAST-Gateway']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'}, 'oper': 'CREATE', 'request-id': 'req-525038e7-d13f-4d8e-8c8f-07792c9d7fc8', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:53:42.277 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = node_profile identifier_name = default-global-system-config:juniper-srx url = http://10.0.0.43:8082/node-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"node-profile": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-srx"], "parent_type": "global-system-config", "node_profile_vendor": "Juniper", "node_profile_device_family": "junos", "node_profile_hitless_upgrade": false, "node_profile_roles": {"role_mappings": [{"physical_role": "pnf", "rb_roles": ["PNF-Servicechain"]}]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "juniper-srx"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:42.348 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'obj_dict': {'display_name': 'juniper-srx', 'fq_name': ['default-global-system-config', 'juniper-srx'], 'id_perms': {'created': '2025-01-16T00:53:42.314950', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.314950', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11725527423995702573, 'uuid_mslong': 7965711152573927165}}, 'node_profile_device_family': 'junos', 'node_profile_hitless_upgrade': False, 'node_profile_roles': {'role_mappings': [{'physical_role': 'pnf', 'rb_roles': ['PNF-Servicechain']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'}, 'oper': 'CREATE', 'request-id': 'req-1bbae6b6-f99e-43dd-b79a-fd35d0a436bf', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:53:42.456 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'device-functional-group'], 'obj_dict': {'display_name': 'device-functional-group', 'fq_name': ['default-global-system-config', 'device-functional-group'], 'id_perms': {'created': '2025-01-16T00:53:42.428656', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.428656', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9664469699845187544, 'uuid_mslong': 15173666237774905906}}, 'node_profile_roles': {'role_mappings': [{'physical_role': 'leaf', 'rb_roles': ['CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'CRB-MCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}, {'physical_role': 'spine', 'rb_roles': ['lean', 'CRB-Access', 'CRB-Gateway', 'DC-Gateway', 'Route-Reflector', 'CRB-MCAST-Gateway', 'DCI-Gateway', 'ERB-UCAST-Gateway', 'PNF-Servicechain', 'AR-Client', 'AR-Replicator']}]}, 'node_profile_vendor': 'Juniper', 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd293b10c-bae9-4232-861f-17fcc9cc67d8'}, 'oper': 'CREATE', 'request-id': 'req-e1e159c2-bdf8-4097-b877-4f2f21167c90', 'type': 'node_profile', 'uuid': 'd293b10c-bae9-4232-861f-17fcc9cc67d8'} 01/16/2025 00:53:42.533 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'obj_dict': {'display_name': 'default-telemetry-profile-1', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'id_perms': {'created': '2025-01-16T00:53:42.517790', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.517790', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10125440959803427003, 'uuid_mslong': 45614543227012761}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '00a20e2f-75a3-4699-8c84-cae7f34608bb'}, 'oper': 'CREATE', 'request-id': 'req-ef9ab3ab-e812-4ad5-a01d-20183b6d5035', 'type': 'telemetry_profile', 'uuid': '00a20e2f-75a3-4699-8c84-cae7f34608bb'} 01/16/2025 00:53:42.569 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-2 url = http://10.0.0.43:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-2"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-2"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:42.612 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'obj_dict': {'display_name': 'default-telemetry-profile-2', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'id_perms': {'created': '2025-01-16T00:53:42.601576', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.601576', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13386614808464629495, 'uuid_mslong': 4877856511808324176}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '43b1a0a7-4ba9-4250-b9c6-cf3e33849ef7'}, 'oper': 'CREATE', 'request-id': 'req-7320545a-4690-492d-bb7e-f1aeb2bb7c3c', 'type': 'telemetry_profile', 'uuid': '43b1a0a7-4ba9-4250-b9c6-cf3e33849ef7'} 01/16/2025 00:53:42.678 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'obj_dict': {'display_name': 'default-telemetry-profile-3', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'id_perms': {'created': '2025-01-16T00:53:42.667962', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.667962', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13629099487276639698, 'uuid_mslong': 14126978739942279367}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'c40d1c50-e7c1-48c7-bd24-49c60b9525d2'}, 'oper': 'CREATE', 'request-id': 'req-79998b68-a3b4-41c7-8f85-fdd5d9a767a0', 'type': 'telemetry_profile', 'uuid': 'c40d1c50-e7c1-48c7-bd24-49c60b9525d2'} 01/16/2025 00:53:42.777 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'obj_dict': {'display_name': 'default-telemetry-profile-4', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'id_perms': {'created': '2025-01-16T00:53:42.765147', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.765147', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11601713174267344937, 'uuid_mslong': 5150264645970773721}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '47796a68-8257-46d9-a101-90a9da2cb829'}, 'oper': 'CREATE', 'request-id': 'req-f57a650c-ff6e-46aa-9331-31e3a404cd22', 'type': 'telemetry_profile', 'uuid': '47796a68-8257-46d9-a101-90a9da2cb829'} 01/16/2025 00:53:42.799 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = telemetry_profile identifier_name = default-domain:default-project:default-telemetry-profile-5 url = http://10.0.0.43:8082/telemetry-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"telemetry-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "default-telemetry-profile-5"], "parent_type": "project", "telemetry_profile_is_default": true, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "default-telemetry-profile-5"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:42.838 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'obj_dict': {'display_name': 'default-telemetry-profile-5', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'id_perms': {'created': '2025-01-16T00:53:42.823664', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.823664', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10248711190002256829, 'uuid_mslong': 7238836328927544103}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': '64758349-c4eb-4327-8e3a-bc86fda7cbbd'}, 'oper': 'CREATE', 'request-id': 'req-632e6303-1d9c-46fa-8e99-0ae6dc243c2f', 'type': 'telemetry_profile', 'uuid': '64758349-c4eb-4327-8e3a-bc86fda7cbbd'} 01/16/2025 00:53:42.941 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'obj_dict': {'display_name': 'default-telemetry-profile-6', 'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'id_perms': {'created': '2025-01-16T00:53:42.923030', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:42.923030', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11591073650562645242, 'uuid_mslong': 13577071857950212685}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'telemetry_profile_is_default': True, 'uuid': 'bc6b72eb-9f13-424d-a0db-c412b32d3cfa'}, 'oper': 'CREATE', 'request-id': 'req-14c6bf3d-5959-444e-9eb3-0087d66434e0', 'type': 'telemetry_profile', 'uuid': 'bc6b72eb-9f13-424d-a0db-c412b32d3cfa'} 01/16/2025 00:53:43.046 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'obj_dict': {'display_name': 'sflow-all-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-all-interfaces'], 'id_perms': {'created': '2025-01-16T00:53:43.030331', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.030331', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9415635058413110647, 'uuid_mslong': 13604202057157985818}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'all', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'bccbd5b1-5d8a-461a-82ab-0e330f6d8577'}, 'oper': 'CREATE', 'request-id': 'req-041d1726-a826-46ba-ab9d-2399bf7463e9', 'type': 'sflow_profile', 'uuid': 'bccbd5b1-5d8a-461a-82ab-0e330f6d8577'} 01/16/2025 00:53:43.075 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = sflow_profile identifier_name = default-domain:default-project:sflow-fabric-interfaces url = http://10.0.0.43:8082/sflow-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"sflow-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "sflow-fabric-interfaces"], "parent_type": "project", "sflow_profile_is_default": true, "sflow_parameters": {"stats_collection_frequency": {"sample_rate": 2000, "polling_interval": 0, "direction": null}, "agent_id": null, "adaptive_sample_rate": 300, "enabled_interface_type": "fabric", "enabled_interface_params": []}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "sflow-fabric-interfaces"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:43.115 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'obj_dict': {'display_name': 'sflow-fabric-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-fabric-interfaces'], 'id_perms': {'created': '2025-01-16T00:53:43.102782', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.102782', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10430448576254839937, 'uuid_mslong': 12250870973910697622}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'fabric', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'aa03d63e-2d17-4696-90c0-65b79ba60c81'}, 'oper': 'CREATE', 'request-id': 'req-6a01fba4-3003-443e-93f9-af1090b046e4', 'type': 'sflow_profile', 'uuid': 'aa03d63e-2d17-4696-90c0-65b79ba60c81'} 01/16/2025 00:53:43.198 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'obj_dict': {'display_name': 'sflow-access-interfaces', 'fq_name': ['default-domain', 'default-project', 'sflow-access-interfaces'], 'id_perms': {'created': '2025-01-16T00:53:43.180913', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.180913', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10022951390448256172, 'uuid_mslong': 15856425214674029795}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'sflow_parameters': {'adaptive_sample_rate': 300, 'agent_id': None, 'enabled_interface_params': [], 'enabled_interface_type': 'access', 'stats_collection_frequency': {'direction': None, 'polling_interval': 0, 'sample_rate': 2000}}, 'sflow_profile_is_default': True, 'uuid': 'dc0d56b8-c831-4ce3-8b18-ad2f8cad04ac'}, 'oper': 'CREATE', 'request-id': 'req-b73eb336-c69d-48c8-a2f0-b9b7533e6ca7', 'type': 'sflow_profile', 'uuid': 'dc0d56b8-c831-4ce3-8b18-ad2f8cad04ac'} 01/16/2025 00:53:43.268 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'obj_dict': {'display_name': 'grpc-default-profile', 'fq_name': ['default-domain', 'default-project', 'grpc-default-profile'], 'grpc_parameters': {'allow_clients': {'subnet': [{'ip_prefix': '0.0.0.0', 'ip_prefix_len': 0}]}, 'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}, 'secure_mode': None}, 'grpc_profile_is_default': True, 'id_perms': {'created': '2025-01-16T00:53:43.257298', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.257298', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12226634782974240950, 'uuid_mslong': 3966791018387752799}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '370cdf6a-0d36-475f-a9ad-bb8e3d9d68b6'}, 'oper': 'CREATE', 'request-id': 'req-b24d7157-b89f-4d94-8e5d-4662cd148ec7', 'type': 'grpc_profile', 'uuid': '370cdf6a-0d36-475f-a9ad-bb8e3d9d68b6'} 01/16/2025 00:53:43.288 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = snmp_profile identifier_name = default-domain:default-project:snmp-default-profile url = http://10.0.0.43:8082/snmp-profiles operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"snmp-profile": {"uuid": null, "fq_name": ["default-domain", "default-project", "snmp-default-profile"], "parent_type": "project", "snmp_profile_is_default": true, "snmp_parameters": {"enabled_sensor_params": {"physical_health": true, "interface_health": true, "control_plane_health": true, "service_layer_health": true}}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "snmp-default-profile"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:43.294 7f9844de0f60 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4b513fa7-8682-4c9a-9ac3-44c1bce7669c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.43:8082/global-vrouter-config/4b513fa7-8682-4c9a-9ac3-44c1bce7669c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.23 body = {"global-vrouter-config": {"uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:43.310 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-9b259874-e6bf-4ec6-ac32-2d0bb146de46', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:43.330 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'obj_dict': {'display_name': 'snmp-default-profile', 'fq_name': ['default-domain', 'default-project', 'snmp-default-profile'], 'id_perms': {'created': '2025-01-16T00:53:43.317239', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.317239', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11610625011729682330, 'uuid_mslong': 7476638141344728265}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'snmp_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'snmp_profile_is_default': True, 'uuid': '67c25ac6-d0fd-44c9-a121-39eeb469cf9a'}, 'oper': 'CREATE', 'request-id': 'req-46a15656-7770-4723-b1ff-8dde2c9f7871', 'type': 'snmp_profile', 'uuid': '67c25ac6-d0fd-44c9-a121-39eeb469cf9a'} 01/16/2025 00:53:43.340 7f9844ed56d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 4b513fa7-8682-4c9a-9ac3-44c1bce7669c object_type = global_vrouter_config identifier_name = default-global-system-config:default-global-vrouter-config url = http://10.0.0.43:8082/global-vrouter-config/4b513fa7-8682-4c9a-9ac3-44c1bce7669c operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_global_vrouter_config.py remote_ip = 10.0.0.43 body = {"global-vrouter-config": {"uuid": "4b513fa7-8682-4c9a-9ac3-44c1bce7669c", "fq_name": ["default-global-system-config", "default-global-vrouter-config"], "parent_type": "global-system-config", "port_translation_pools": {"port_translation_pool": []}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:43.355 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-09792378-cdbb-402e-908d-639151ba43ab', 'type': 'global_vrouter_config', 'uuid': '4b513fa7-8682-4c9a-9ac3-44c1bce7669c'} 01/16/2025 00:53:43.395 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'obj_dict': {'display_name': 'netconf-default-profile', 'fq_name': ['default-domain', 'default-project', 'netconf-default-profile'], 'id_perms': {'created': '2025-01-16T00:53:43.384783', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.384783', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9940337575973253145, 'uuid_mslong': 8110334156363023048}}, 'netconf_parameters': {'enabled_sensor_params': {'control_plane_health': True, 'interface_health': True, 'physical_health': True, 'service_layer_health': True}}, 'netconf_profile_is_default': True, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '708db1f1-dfbc-42c8-89f3-2c5bf35a7019'}, 'oper': 'CREATE', 'request-id': 'req-525a021b-0a37-4cb0-a1c7-49000ed6c72c', 'type': 'netconf_profile', 'uuid': '708db1f1-dfbc-42c8-89f3-2c5bf35a7019'} 01/16/2025 00:53:43.490 7f9844f31390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:43.491 7f9844f31390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:43.491 7f9844f31390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:43.491 7f9844f31390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:43.491 7f9844f31390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:43.492 7f9844f31390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:43.499 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L2 servers ' 'connectivity with ' 'ingress replication for ' 'multicast in the spine', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Access', 'AR-Client']}, 'display_name': 'L2-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'id_perms': {'created': '2025-01-16T00:53:43.488112', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.488112', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12267731006696978166, 'uuid_mslong': 3471850980453272820}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '302e7e12-7302-4cf4-aa3f-bc5a7637f6f6'}, 'oper': 'CREATE', 'request-id': 'req-2ca168e4-3214-467b-8f23-a0cfb1b0911f', 'type': 'device_functional_group', 'uuid': '302e7e12-7302-4cf4-aa3f-bc5a7637f6f6'} 01/16/2025 00:53:43.519 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf url = http://10.0.0.43:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity", "device_functional_group_os_version": "19.1R3", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:43.579 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity', 'device_functional_group_os_version': '19.1R3', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Server-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'id_perms': {'created': '2025-01-16T00:53:43.561780', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.561780', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10839886859135907138, 'uuid_mslong': 3938101344968656192}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '36a6f24e-ec58-4540-966f-03aa8c387542'}, 'oper': 'CREATE', 'request-id': 'req-1b995da5-6574-4fd7-8fa5-c8bb8b079ef9', 'type': 'device_functional_group', 'uuid': '36a6f24e-ec58-4540-966f-03aa8c387542'} 01/16/2025 00:53:43.666 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'connectivity at spines', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['CRB-Gateway']}, 'display_name': 'L3-Gateway-Spine', 'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'id_perms': {'created': '2025-01-16T00:53:43.650299', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.650299', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11919221540797597558, 'uuid_mslong': 5153890306086815350}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '47864bed-49a2-4676-a569-94d7326cc776'}, 'oper': 'CREATE', 'request-id': 'req-24c11f2a-3c7f-4222-baaf-a0cbf8eac046', 'type': 'device_functional_group', 'uuid': '47864bed-49a2-4676-a569-94d7326cc776'} 01/16/2025 00:53:43.770 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'obj_dict': {'device_functional_group_description': 'Provides L3 connectivity ' 'to storage arrays', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway']}, 'display_name': 'L3-Storage-Leaf', 'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'id_perms': {'created': '2025-01-16T00:53:43.756030', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.756030', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11906091881151350422, 'uuid_mslong': 13434949743385134924}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ba72879c-35b2-474c-a53a-ef7c17304696'}, 'oper': 'CREATE', 'request-id': 'req-7e1e3af8-1fcf-49d2-8099-3f6fd1435ddd', 'type': 'device_functional_group', 'uuid': 'ba72879c-35b2-474c-a53a-ef7c17304696'} 01/16/2025 00:53:43.805 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:L3-Server-Leaf-with-Optimized-Multicast url = http://10.0.0.43:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "L3-Server-Leaf-with-Optimized-Multicast"], "parent_type": "project", "device_functional_group_description": "Provides L3 servers connectivity with Optimized multicast traffic", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["ERB-UCAST-Gateway", "AR-Client"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "L3-Server-Leaf-with-Optimized-Multicast"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:43.844 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 servers ' 'connectivity with ' 'Optimized multicast ' 'traffic', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['ERB-UCAST-Gateway', 'AR-Client']}, 'display_name': 'L3-Server-Leaf-with-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'id_perms': {'created': '2025-01-16T00:53:43.834934', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.834934', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9368115956038118615, 'uuid_mslong': 16736164112535080651}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e842cc96-9e4b-4ecb-8202-3bd3de522cd7'}, 'oper': 'CREATE', 'request-id': 'req-23794bc5-9602-4ce6-97d9-1b4bc73ae0b9', 'type': 'device_functional_group', 'uuid': 'e842cc96-9e4b-4ecb-8202-3bd3de522cd7'} 01/16/2025 00:53:43.975 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing ' 'for L2 server leafs and ' 'route reflector and ' 'ingress replication, as ' 'well DCGW and DCI GW and ' 'connectivity to ' 'firewalls', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'id_perms': {'created': '2025-01-16T00:53:43.950914', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:43.950914', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11127388766207475630, 'uuid_mslong': 8826980385072235574}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7a7fbbe4-9392-4436-9a6c-6d209f77ffae'}, 'oper': 'CREATE', 'request-id': 'req-b542f19a-de0a-49af-8222-1e34ec291c20', 'type': 'device_functional_group', 'uuid': '7a7fbbe4-9392-4436-9a6c-6d209f77ffae'} 01/16/2025 00:53:44.084 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'obj_dict': {'device_functional_group_description': 'Provides L3 routing and ' 'gateway services for L2 ' 'server leafs ; provides ' 'route reflector and ' 'assisted replication', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'AR-Replicator', 'CRB-Gateway', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain']}, 'display_name': 'Centrally-Routed-Border-Spine-With-Optimized-Multicast', 'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'id_perms': {'created': '2025-01-16T00:53:44.068088', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.068088', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9308726935904454881, 'uuid_mslong': 11358222592009912443}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9da08344-dc91-407b-812f-3dd415b208e1'}, 'oper': 'CREATE', 'request-id': 'req-a5ddcab0-d877-4b14-8083-efa200a7c1b6', 'type': 'device_functional_group', 'uuid': '9da08344-dc91-407b-812f-3dd415b208e1'} 01/16/2025 00:53:44.107 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = device_functional_group identifier_name = default-domain:default-project:Border-Spine-in-Edge-Routed url = http://10.0.0.43:8082/device-functional-groups operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"device-functional-group": {"uuid": null, "fq_name": ["default-domain", "default-project", "Border-Spine-in-Edge-Routed"], "parent_type": "project", "device_functional_group_description": "Provides L3 gateway services, route reflector", "device_functional_group_os_version": "18.4R2", "device_functional_group_routing_bridging_roles": {"rb_roles": ["Route-Reflector", "DC-Gateway", "DCI-Gateway", "PNF-Servicechain", "CRB-MCAST-Gateway"]}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "Border-Spine-in-Edge-Routed"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:44.190 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Spine-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'id_perms': {'created': '2025-01-16T00:53:44.176782', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.176782', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9599072937484168625, 'uuid_mslong': 9198324321492748141}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7fa7033c-4f69-476d-8536-c1fa83cf2db1'}, 'oper': 'CREATE', 'request-id': 'req-85bffcd8-fb42-4ae7-aca6-56821a486f84', 'type': 'device_functional_group', 'uuid': '7fa7033c-4f69-476d-8536-c1fa83cf2db1'} 01/16/2025 00:53:44.296 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'obj_dict': {'device_functional_group_description': 'Provides L3 gateway ' 'services, route ' 'reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'DC-Gateway', 'DCI-Gateway', 'PNF-Servicechain', 'CRB-MCAST-Gateway']}, 'display_name': 'Border-Leaf-in-Edge-Routed', 'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'id_perms': {'created': '2025-01-16T00:53:44.279276', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.279276', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11704132100058745537, 'uuid_mslong': 1922596045183009699}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1aae6eea-afb4-43a3-a26d-6e22443f8ac1'}, 'oper': 'CREATE', 'request-id': 'req-b40f6f1e-ecb1-43fb-9b78-288b9150c2fd', 'type': 'device_functional_group', 'uuid': '1aae6eea-afb4-43a3-a26d-6e22443f8ac1'} 01/16/2025 00:53:44.397 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'obj_dict': {'device_functional_group_description': 'Spine only acting as ' 'Route Reflector', 'device_functional_group_os_version': '18.4R2', 'device_functional_group_routing_bridging_roles': {'rb_roles': ['Route-Reflector', 'lean']}, 'display_name': 'Lean-Spine-with-Route-Reflector', 'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'id_perms': {'created': '2025-01-16T00:53:44.384820', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.384820', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10306466728955125137, 'uuid_mslong': 14626768353740934249}}, 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'cafcb852-60a7-4c69-8f07-ece24cc09d91'}, 'oper': 'CREATE', 'request-id': 'req-55c74daf-2638-4ef1-967c-620cffaff177', 'type': 'device_functional_group', 'uuid': 'cafcb852-60a7-4c69-8f07-ece24cc09d91'} 01/16/2025 00:53:44.429 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5k-lean:basic url = http://10.0.0.43:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5k-lean", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:44.481 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.468672', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.468672', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10408771426472763989, 'uuid_mslong': 9953019555256549960}}, 'parent_type': 'node-profile', 'parent_uuid': '56af72da-9513-403f-b908-7be5f47aa31c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '8a203a8d-5995-4248-9073-6276df252255'}, 'oper': 'CREATE', 'request-id': 'req-b660d2c4-17dc-41e8-a86b-13f8b0f6c3a1', 'type': 'role_config', 'uuid': '8a203a8d-5995-4248-9073-6276df252255'} 01/16/2025 00:53:44.512 7f9844e1c438 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/global-system-config/22978d74-648d-4342-9707-c760fd7f98ed operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.23 body = {"global-system-config": {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:44.538 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5k', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.519881', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.519881', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10684892796765086106, 'uuid_mslong': 1626293660618014924}}, 'parent_type': 'node-profile', 'parent_uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '1691c177-c59b-40cc-9448-5d633e50219a'}, 'oper': 'CREATE', 'request-id': 'req-0771662a-753f-4e6e-ba80-cd16ad7dfb4b', 'type': 'role_config', 'uuid': '1691c177-c59b-40cc-9448-5d633e50219a'} 01/16/2025 00:53:44.570 7f9844f82828 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/global-system-config/22978d74-648d-4342-9707-c760fd7f98ed operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.43 body = {"global-system-config": {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "autonomous_system": 64512, "ibgp_auto_mesh": true}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:44.582 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-818c0f7f-78c3-460c-8d97-4e062b19aa2c', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:53:44.628 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-c3416071-1b78-4ad2-8a68-7766df6326d2', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:53:44.645 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5120', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.621969', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.621969', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10265631177010328736, 'uuid_mslong': 7293676657781917170}}, 'parent_type': 'node-profile', 'parent_uuid': 'e234893d-56e3-48be-9871-542d7c7261f7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '65385846-d5a6-45f2-8e76-d92a74e034a0'}, 'oper': 'CREATE', 'request-id': 'req-599819ba-9058-4b5b-9442-0fdfd6cc68be', 'type': 'role_config', 'uuid': '65385846-d5a6-45f2-8e76-d92a74e034a0'} 01/16/2025 00:53:44.664 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-qfx5220:basic url = http://10.0.0.43:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-qfx5220", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:44.712 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx5220', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.694540', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.694540', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9288693857577705384, 'uuid_mslong': 6705367877396745106}}, 'parent_type': 'node-profile', 'parent_uuid': '7d37b8a5-98f1-49df-9c1b-3c81680708fe', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '5d0e408e-d48c-4b92-80e8-11d990459fa8'}, 'oper': 'CREATE', 'request-id': 'req-beb8831f-7b13-4e66-8e98-5a4c18e872c5', 'type': 'role_config', 'uuid': '5d0e408e-d48c-4b92-80e8-11d990459fa8'} 01/16/2025 00:53:44.768 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.757575', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.757575', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12465128450547580328, 'uuid_mslong': 2724552714540696494}}, 'parent_type': 'node-profile', 'parent_uuid': 'd38c38dc-01d6-4686-9569-94c9abfe6045', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '25cf8e42-3206-43ae-acfd-08485e80fda8'}, 'oper': 'CREATE', 'request-id': 'req-83ce7b4b-0d55-4ba5-8d18-f34982f4350d', 'type': 'role_config', 'uuid': '25cf8e42-3206-43ae-acfd-08485e80fda8'} 01/16/2025 00:53:44.832 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-qfx10k', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.822539', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.822539', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12845833294929660113, 'uuid_mslong': 15946678094398833896}}, 'parent_type': 'node-profile', 'parent_uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'dd4dfb3c-dc25-44e8-b245-9152542b08d1'}, 'oper': 'CREATE', 'request-id': 'req-a4d5ab23-68bb-479c-8c13-767beea75394', 'type': 'role_config', 'uuid': 'dd4dfb3c-dc25-44e8-b245-9152542b08d1'} 01/16/2025 00:53:44.854 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = role_config identifier_name = default-global-system-config:juniper-mx:basic url = http://10.0.0.43:8082/role-configs operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"role-config": {"uuid": null, "fq_name": ["default-global-system-config", "juniper-mx", "basic"], "parent_type": "node-profile", "role_config_config": "{\"snmp\": {\"communities\": [{\"readonly\": true, \"name\": \"public\"}]}}", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "basic"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:53:44.895 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-mx', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.876628', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.876628', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10792867923008026999, 'uuid_mslong': 9853703346132108234}}, 'parent_type': 'node-profile', 'parent_uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': '88bf62fc-7448-43ca-95c7-f8316299f977'}, 'oper': 'CREATE', 'request-id': 'req-4fc74160-2ea3-4d23-9ef2-e8556f0d864a', 'type': 'role_config', 'uuid': '88bf62fc-7448-43ca-95c7-f8316299f977'} 01/16/2025 00:53:44.960 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'obj_dict': {'display_name': 'basic', 'fq_name': ['default-global-system-config', 'juniper-srx', 'basic'], 'id_perms': {'created': '2025-01-16T00:53:44.948501', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:53:44.948501', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10591113408600588061, 'uuid_mslong': 15826011980799625148}}, 'parent_type': 'node-profile', 'parent_uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'role_config_config': '{"snmp": {"communities": [{"readonly": ' 'true, "name": "public"}]}}', 'uuid': 'dba14a0b-f6a3-47bc-92fb-3187ef83bf1d'}, 'oper': 'CREATE', 'request-id': 'req-b97a220d-a488-4c12-9441-1df0d114491a', 'type': 'role_config', 'uuid': 'dba14a0b-f6a3-47bc-92fb-3187ef83bf1d'} 01/16/2025 00:53:45.014 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c9cd8879-98cc-4d6e-9cd7-b03dc6f5e3a3', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.100 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1cf83883-a9f7-4cda-b7b5-4b173a6005aa', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.189 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-780d8935-9b30-4ff5-9560-72dbeaed0412', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.281 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9751dff0-9847-41fa-8d56-e98f1487c94a', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.367 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-36d0dbd5-5322-4c52-8c93-4ea95eabcce0', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.453 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3df5435f-6bc3-4ab8-abcc-b90b7fa739ee', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.539 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-aba5953c-0199-4e7f-a1a6-1c6ffd3ece02', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.640 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-28894508-efd7-4989-944b-f425ce2064fd', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.727 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2ee71931-350e-4ea1-83ec-36874a24f310', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.817 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-83845bb1-1a7c-4f1c-8cca-7b4a2e4e6969', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:45.917 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-69c27f26-4ce0-4921-8b40-d3aa2a02ab2d', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.004 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-7dfb9602-7021-4823-8580-4959d812250a', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.091 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-51a5be7b-ce8a-424b-90c9-57b42467ac6d', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.176 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a2959670-7c56-4356-bdb5-9e848a91b4fd', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.259 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d9cfb744-25d2-43b4-9606-490ec36b7d2e', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.353 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0dacd0c6-9bf3-46a3-8432-1a0e00524bed', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.439 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-61251c16-a6f9-4682-b1d3-b5bbdc52356e', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.543 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-85564bd2-0471-4b9e-9f42-3189d92bcbd4', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:46.635 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-432b8928-a4e9-4632-b04a-cc2448408bd8', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:46.728 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-e0bc9efc-bbea-49a0-815c-4fb7c6dcfc29', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:46.819 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-2aa6b8f8-c819-4893-b50b-08d606710e11', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:46.904 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-f2c1fa61-61a5-4525-a478-013fb8b362ca', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:46.985 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-465a8571-2e67-41e8-9960-7cb34d716ca4', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:47.076 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-73949fd1-cb67-4ddd-b1b5-dbb3ab9b47f0', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:47.173 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-50f1ef5c-e3f3-4373-9a6d-c4af1eaf32b8', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:47.263 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-c302f8d0-993b-4fa1-8556-bd146cf1be0b', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:47.348 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-03ee411d-d19a-4612-bc8d-2a931b447721', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.434 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c851ca5a-b0aa-4e4d-b340-63951d7bed47', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.492 7f9844f0c630 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:47.493 7f9844f0c630 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:47.494 7f9844f0c630 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:47.494 7f9844f0c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:47.494 7f9844f0c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:47.494 7f9844f0c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:47.494 7f9844f0c630 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:47.495 7f9844f0c630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:47.518 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0e8059aa-707f-4bdc-bc0b-1d0f4abd8a8d', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.602 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-75924cf3-c307-490f-8629-79c93ce24fd3', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.692 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-12d5b425-a391-4a0a-8518-185411687248', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.782 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-91604f03-bd93-4a34-8afa-e05c412cf269', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.874 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ece311a5-f086-442a-9c5d-a9ebc0dd4b9d', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:47.958 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-eb223e5a-f941-4d76-8a55-3d2195827e6a', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:48.054 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-602c70f4-08de-489a-9a4c-99073423d2d0', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.152 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-4a457f4f-67cb-4b99-bdfa-e845caeffbdb', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.235 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e3272f15-18a6-4e46-81a1-a957afcb62ae', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.321 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2c798bc4-4a93-498a-a3d5-db36b8a2f5b3', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.401 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6d349a01-8f6c-497f-90b9-ae72f312afe9', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.484 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-0e398363-13da-45a1-96ea-7e87e5c59f22', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.568 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1c7ae3e7-7d8c-4d20-afee-4d87666d2f45', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.653 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1c96ff80-d837-4472-bddf-da052b96f617', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:48.742 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-b972f92a-f8c3-41c9-b706-1c493e89aae6', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:48.829 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-00b15ce3-39e3-4205-b6b0-a1a946e7a809', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:48.908 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4d1ece7b-daed-475e-9f80-c792e94b558d', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:48.995 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fe164518-6094-44d1-9abc-dc472731f956', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:49.089 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-5676f98a-d7c3-463e-b8ec-aeaa872cc370', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:49.181 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ad71cfb3-dd80-4d1e-9ed1-97253ae34034', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:49.270 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-30e112c2-baf4-4e73-85f7-7ea1908f2e2a', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:49.358 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f581b009-a005-44ee-909b-92dd2307cb97', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.442 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f0ef1ba6-0381-4b97-b461-19449e08c2a3', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.525 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-8ced7db2-fdeb-4732-8e18-5634739d90b4', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.608 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3a0f60cd-b1f6-44cf-976c-81581c8aa0e1', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.687 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e9450151-3cb6-4c96-97e8-cbce9e223774', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.767 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6d31c83d-c2fd-4524-8d56-962ed8fc542b', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.847 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-6a00eda0-ac1a-459b-953f-869d66541786', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:49.931 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-5b6bcd96-7fd4-417c-a53e-c84a13391002', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.015 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-0147f063-8537-4aff-aad1-7cd88d7a8446', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.112 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cc475b0b-1b66-49b4-8640-39054dc87c31', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.198 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-db3b4282-04af-45a4-a9dd-217300123c93', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.286 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-31c48e6b-d831-4124-b4ea-cba76c8cfc17', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.373 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-24c438c2-2b8a-462e-a2d1-393a2c91ab4d', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.462 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-368f2494-26ce-4383-8e2d-81643a95c0e0', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.571 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e4ddee63-1bb1-4424-bb6a-3d30dc767cca', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.656 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3455e3e1-1e0b-4cbf-bc64-3bfd04618513', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:50.769 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-75b1f721-6909-4a4f-9e29-117de273de7d', 'type': 'role_definition', 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'} 01/16/2025 00:53:50.856 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-c7b00ac8-25db-425d-a6e8-877302ddc499', 'type': 'role_definition', 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'} 01/16/2025 00:53:50.945 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-162c9263-fc58-4d30-9c61-c6f5f279bb49', 'type': 'role_definition', 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'} 01/16/2025 00:53:51.040 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-468f1f53-3372-45c7-a404-bb4112e27c20', 'type': 'role_definition', 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'} 01/16/2025 00:53:51.123 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-superspine'], 'oper': 'UPDATE', 'request-id': 'req-889a9f5d-ccbc-4092-89df-cfbcb7071a1c', 'type': 'role_definition', 'uuid': 'b4e320ce-7e46-4dff-9033-947a7fe72061'} 01/16/2025 00:53:51.219 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-c19cc4e2-179e-4bb2-bd74-8c98f4fda8a7', 'type': 'role_definition', 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'} 01/16/2025 00:53:51.310 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-337dbf60-fb43-4ae9-883b-69d923e3a3bd', 'type': 'role_definition', 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'} 01/16/2025 00:53:51.388 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-04fbf8a5-767c-442f-bf86-70c430e405c9', 'type': 'role_definition', 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'} 01/16/2025 00:53:51.486 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-f82f025f-2874-4467-92f5-1f29be23e39e', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:51.494 7f9844ea22e8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:51.494 7f9844ea22e8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:51.495 7f9844ea22e8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:51.496 7f9844ea22e8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:51.496 7f9844ea22e8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:51.573 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9f27d175-1771-4f5b-8ba0-ea84a21ac590', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:51.679 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-918aa020-39f3-4f76-8d14-9954c5569e16', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:51.773 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d7e9a502-fead-4ea8-b3ce-04cc1aeab485', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:51.899 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1916d932-331d-47de-8af9-003827bb3bf2', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:51.999 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-47a97a66-c558-4ebb-b72d-a8507a6e60c5', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:52.088 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-52ba30c3-ae92-4fb5-900c-387e6f90ca3c', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:52.178 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-76c7eb7a-12a5-403b-900e-b03282722c0d', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:52.271 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-576b277c-0dbf-45be-a174-a9c6c1f38731', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:52.363 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-3101ba5c-b572-4848-9806-7b99a452105f', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.449 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e27d1f1a-9c42-4f1d-aec6-06627a9daa71', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.526 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-cc288a3a-4379-4880-9e55-626548808774', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.608 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fa11ce4f-6f12-4624-b75f-a21632406970', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.698 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-e8ef8506-57e2-4ded-8c08-b76e86d2a4ce', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.793 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-7d198c4f-b00e-4fad-bdf4-2e9764b5d291', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.873 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-f80caf3a-b91e-47c1-8697-cb1c44c82f93', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:52.976 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4e3f7373-bf38-47ba-9636-8042ded58b3a', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:53.064 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8b5fcc31-9d06-4c6b-a6cd-761402582f71', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:53.170 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-d215a2ee-b362-41fc-9161-874816e81d47', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.258 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-df790732-f218-40b1-b19d-44a36df3a6a5', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.361 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-11a47e1e-509b-4a20-b22a-55c3713c07dd', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.468 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-56f189de-70fa-4654-9037-3f3b90a0e917', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.569 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-860dd5ba-96c9-4f41-be09-7e570803559a', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.656 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c674f8d0-2946-4332-a974-b1b4432b6550', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.752 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-88450b6c-2c7c-4dd8-937a-78d6095316ad', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.849 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-84837ce5-a86f-409b-a543-9dc64cd18d34', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:53.930 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-72296be5-02b4-458e-9a77-8d0d9adbd46c', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:54.009 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-e46f8b3c-6925-406d-96f2-e87fb8a20938', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:54.095 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-332a44af-de05-4201-a627-dec578f96e5a', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:54.191 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-245a2407-8980-45db-8de8-c724198ca450', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:54.279 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c8d30943-e30d-4ce7-b2ae-03e868ccb149', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:54.376 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-75f37697-3484-4d67-9c54-e5ec9bf24be9', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:54.478 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-862831b5-7c99-49d0-b0a2-7507f7f9ac3f', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:54.565 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-6f0017ea-28f9-4e6b-80ea-9418e5059e22', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:54.652 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-87a6aaa1-cc98-4836-9e2b-ba9ef8bf0851', 'type': 'role_definition', 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'} 01/16/2025 00:53:54.739 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-40783827-9d45-4aff-a296-de6e0cb1bc34', 'type': 'role_definition', 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'} 01/16/2025 00:53:54.825 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-736303b7-4e34-4742-b367-a4fb726d82d9', 'type': 'role_definition', 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'} 01/16/2025 00:53:54.915 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-6d36d406-2b45-445c-ac15-d4a79184c144', 'type': 'role_definition', 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'} 01/16/2025 00:53:54.998 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-ec3bb5ad-2564-464a-815d-1edc89391008', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:55.105 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-dc858402-2edc-49ba-9cf8-eda3722b679f', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:55.201 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-69319bd4-645b-487c-973e-08b77edc222e', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:55.299 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-1fcc778e-9cbb-4a35-b041-acdf8de432bc', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:55.392 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-64214bf3-974a-47bd-8de2-1482b45fbc71', 'type': 'role_definition', 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'} 01/16/2025 00:53:55.480 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a71a8405-9e45-4dc5-9564-49adb7a74f71', 'type': 'role_definition', 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'} 01/16/2025 00:53:55.495 7f9844dbbeb8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:55.496 7f9844dbbeb8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:55.496 7f9844dbbeb8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:55.496 7f9844dbbeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:55.496 7f9844dbbeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:55.496 7f9844dbbeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:55.496 7f9844dbbeb8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:55.497 7f9844dbbeb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:55.570 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-e10ac94b-3065-4c3f-8cee-d126ac7d2c71', 'type': 'role_definition', 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'} 01/16/2025 00:53:55.670 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-ce3d00f7-d6f2-428b-aeda-4b3f1df1b991', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:55.764 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-2a3ccba3-609c-4ee9-a920-417ad9dc3c50', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:55.857 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-aa97901f-3de1-42c5-83f1-185349ad4c9a', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:55.941 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-3f3bf098-33c5-4582-bcaa-766d37ccb85b', 'type': 'role_definition', 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'} 01/16/2025 00:53:56.037 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-ebf619d3-298e-471b-b452-7bf686b48cfc', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:56.125 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-80317ea8-bd2e-413f-884e-93ad60c557ce', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:56.207 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-91e7ab57-89d5-4e89-a33e-5c5d150f5053', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:56.293 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-0aa689cf-9164-4307-a866-a91fd3bb0a61', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:56.378 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-superspine'], 'oper': 'UPDATE', 'request-id': 'req-67852bee-e6ff-45dd-b99f-a3d2bec0db6e', 'type': 'role_definition', 'uuid': '19060afd-e0a0-4783-a5b9-9586856a605f'} 01/16/2025 00:53:56.470 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-a5e72886-bdea-4a8e-9333-b9db32d3e6a2', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:56.569 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-7dcde95e-42d5-4d73-999c-641a9ed4ba61', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:56.656 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-babb68c8-515f-4a79-8e78-fae6d75aab4e', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:56.753 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-d13d485b-dcb4-4a15-9e0f-c45d1712ce7e', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:56.847 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2591a575-2a4d-4a4b-a3e6-4f53c3bdbcd2', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:56.933 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e017b2de-be2e-4573-bcf3-7bb45b518548', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:57.025 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-e9a8ac60-45d6-4232-a3d1-e68ba0cf5a0a', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:57.117 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-c9caf88c-95a6-4ecb-8f54-b008d0f3e100', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:57.204 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'erb-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1a820957-0d00-472d-9585-43cea01b7964', 'type': 'role_definition', 'uuid': '6fd354a0-8f00-49cb-aa06-e521fcfcd358'} 01/16/2025 00:53:57.289 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-leaf'], 'oper': 'UPDATE', 'request-id': 'req-85d4de5b-bf22-4906-950b-d718bb7f88fd', 'type': 'role_definition', 'uuid': 'da9d3ca2-4d00-4b57-8a5b-00dfd1a553ff'} 01/16/2025 00:53:57.384 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-access-spine'], 'oper': 'UPDATE', 'request-id': 'req-485a6e2e-dfd1-4c0b-af30-f5670fe151fd', 'type': 'role_definition', 'uuid': 'eae0ea4e-bc62-466f-afdc-b839cfeeae17'} 01/16/2025 00:53:57.466 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-14ee2aa0-44a6-412e-85ef-92df13ff3aab', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:57.546 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-4583ac61-bb4d-4439-99a9-6da67e217d9c', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:57.629 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-c3f263d5-8292-4a73-a781-518dc745bae2', 'type': 'role_definition', 'uuid': '38be14fe-500a-46cc-ab5e-70f34fe95d8c'} 01/16/2025 00:53:57.758 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-ac25cf65-3fe4-4de6-8cf8-af8fe904aa6e', 'type': 'role_definition', 'uuid': '8af3dcda-0abc-4fc4-a936-8d9f0dacc63c'} 01/16/2025 00:53:57.821 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1bfe8f71-11c4-468a-bf39-ad31448b93ae', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:57.924 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-90d557a2-d989-4cf2-9deb-269cbfe8110b', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:58.014 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dc-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a1ceee1c-1f3a-44c8-8091-97dd0d494df7', 'type': 'role_definition', 'uuid': '83b7440c-482d-4594-9f50-2d3d625d3015'} 01/16/2025 00:53:58.107 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'dci-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-95c895ef-f88a-4b41-9562-f38895b3bc3b', 'type': 'role_definition', 'uuid': 'f6679b34-dbc0-4818-87a7-60ff49305f5b'} 01/16/2025 00:53:58.203 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-leaf'], 'oper': 'UPDATE', 'request-id': 'req-777ae4f2-a85c-4e3f-bade-b82427476a3c', 'type': 'role_definition', 'uuid': 'afc05a6f-9ac3-4b97-a6a9-a98831338544'} 01/16/2025 00:53:58.292 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-client-spine'], 'oper': 'UPDATE', 'request-id': 'req-2ac87ced-d9ad-4789-a36a-4cc5c7b7d393', 'type': 'role_definition', 'uuid': '0f0a8f7d-6afe-482d-9e9e-8b0a81d2cd5a'} 01/16/2025 00:53:58.366 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-leaf'], 'oper': 'UPDATE', 'request-id': 'req-a5944b46-3588-4688-ac67-f3c39a90b7d8', 'type': 'role_definition', 'uuid': '2f6d7b45-05f2-4c0f-bc00-ccfc0ceccaf2'} 01/16/2025 00:53:58.450 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'ar-replicator-spine'], 'oper': 'UPDATE', 'request-id': 'req-baf2af62-8bc2-42dc-905b-5223f71c5133', 'type': 'role_definition', 'uuid': '20a82d17-dc84-4607-a646-fd9e5e71f664'} 01/16/2025 00:53:58.531 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-spine'], 'oper': 'UPDATE', 'request-id': 'req-2b0224fe-ec30-44e5-8552-3ae03618e7cf', 'type': 'role_definition', 'uuid': '16c3703e-8695-4924-912f-d1899d9bd242'} 01/16/2025 00:53:58.616 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'rr-leaf'], 'oper': 'UPDATE', 'request-id': 'req-3a7d6eda-d616-4ee5-ac51-12f3c27aa30f', 'type': 'role_definition', 'uuid': '16f9179b-8b4b-416e-96fb-2c476f162e7e'} 01/16/2025 00:53:58.711 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-3d6ddf01-a0cf-4b60-a4fa-3fa0895ba8e6', 'type': 'role_definition', 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'} 01/16/2025 00:53:58.831 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-8be71d77-cd0b-4cff-9c91-3c69c6d7b129', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:58.977 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-db7d69b2-99d9-4693-9485-e8d491bb915a', 'type': 'role_definition', 'uuid': 'a40eb283-d193-4be7-ac61-20e2e83fea7f'} 01/16/2025 00:53:59.076 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-2ee98f32-cd92-4b9b-9a08-0933ae5c38b8', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:59.167 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-1a9f5dff-f252-4d1f-be76-02c1b71f3aa8', 'type': 'role_definition', 'uuid': '77bd0b15-3c87-4aa9-a15f-7c0b757f359f'} 01/16/2025 00:53:59.309 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-fb64b01b-d718-4bfc-babf-666a1c158efa', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:59.458 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-spine'], 'oper': 'UPDATE', 'request-id': 'req-59d257fd-bf74-4f41-abbb-284da8009272', 'type': 'role_definition', 'uuid': '6efba243-4faf-47bf-a168-fd414cd594da'} 01/16/2025 00:53:59.497 7f9845d4b780 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:53:59.500 7f9845d4b780 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:53:59.500 7f9845d4b780 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:53:59.500 7f9845d4b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:59.500 7f9845d4b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:53:59.500 7f9845d4b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:53:59.500 7f9845d4b780 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:53:59.501 7f9845d4b780 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:53:59.578 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-254a0fd3-112e-4cff-b428-bbbd7086e0f6', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:59.699 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'crb-mcast-gateway-leaf'], 'oper': 'UPDATE', 'request-id': 'req-46176e98-3d74-425e-a246-27f370a63f4a', 'type': 'role_definition', 'uuid': '7cc0c2ae-2d2e-40b9-b782-47e4ba9cc8bd'} 01/16/2025 00:53:59.830 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'lean-spine'], 'oper': 'UPDATE', 'request-id': 'req-c8a9fa99-073f-4e3e-a210-d4427deb9625', 'type': 'role_definition', 'uuid': '7ecd2eac-35c5-4b49-b6f7-5d4cff4a9b54'} 01/16/2025 00:53:59.930 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-938e51f3-7062-40cc-a5e8-86131a08de42', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.018 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-375fcb62-5e12-4a55-8124-c3af41489cdc', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.103 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-8d295e5c-7ca0-47c0-93e3-b73b1bb8316a', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.205 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-79ff7fca-27c9-47c0-a3db-625a71856962', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.300 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-ee0bcca4-3d65-4dc3-84c9-4affd38291e1', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.404 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-6ed2aa39-5b03-420e-9912-225548a24a8f', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.509 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-52972a12-9520-4ae0-aa41-be01c16c6a45', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.616 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-384fb703-1608-48ba-a519-920806ed1919', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.711 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-30c79107-200d-47de-b0ed-d34a6fbe61c7', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.800 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-a79ea5a1-ed51-4eda-ba19-76309b564a00', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.893 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'collapsed-spine'], 'oper': 'UPDATE', 'request-id': 'req-5864c499-0432-4f51-ba02-04ab562fc3bb', 'type': 'role_definition', 'uuid': 'bfbef879-36fa-4fc9-9227-661034aa9223'} 01/16/2025 00:54:00.984 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-27ecf768-5453-4091-a550-aa8278f3986d', 'type': 'role_definition', 'uuid': '8b74857b-7393-4fc5-b027-ada2252afa1f'} 01/16/2025 00:54:01.067 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-32753173-72bc-42e8-8a5a-141f9bb3f921', 'type': 'role_definition', 'uuid': '5fed5d6c-ba29-4f10-9ddd-03ab309ff124'} 01/16/2025 00:54:01.156 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-46d23724-e5f6-4b2e-b5da-59d9ab843bee', 'type': 'role_definition', 'uuid': 'e70924fe-c230-496a-a040-d5b5407f1ce6'} 01/16/2025 00:54:01.251 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-86c83870-9dd4-4d69-9367-103838886fb5', 'type': 'role_definition', 'uuid': '8b74857b-7393-4fc5-b027-ada2252afa1f'} 01/16/2025 00:54:01.448 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-c405a0b6-aaac-45d9-b17e-081f83c2baaa', 'type': 'role_definition', 'uuid': '5fed5d6c-ba29-4f10-9ddd-03ab309ff124'} 01/16/2025 00:54:01.563 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-9e84bfc4-c9ae-4f01-a02a-41a70adb5c7d', 'type': 'role_definition', 'uuid': 'e70924fe-c230-496a-a040-d5b5407f1ce6'} 01/16/2025 00:54:01.652 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-pnf'], 'oper': 'UPDATE', 'request-id': 'req-1ba3caf1-a0ac-48b5-b2a1-91a1c959c38f', 'type': 'role_definition', 'uuid': '8b74857b-7393-4fc5-b027-ada2252afa1f'} 01/16/2025 00:54:01.736 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-spine'], 'oper': 'UPDATE', 'request-id': 'req-64faa1f7-45cd-479e-839e-753a59c89dc2', 'type': 'role_definition', 'uuid': '5fed5d6c-ba29-4f10-9ddd-03ab309ff124'} 01/16/2025 00:54:01.820 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'pnf-servicechain-leaf'], 'oper': 'UPDATE', 'request-id': 'req-bda145f4-8eb3-4d78-a2d9-047bfda3dc54', 'type': 'role_definition', 'uuid': 'e70924fe-c230-496a-a040-d5b5407f1ce6'} 01/16/2025 00:54:01.949 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-0d1781f5-2ecf-4482-9181-473c95c9bee1', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.071 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-ee8b06a6-6d2f-43c3-bc63-3e875025a2df', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.166 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-d142bdc2-d3eb-41b8-9708-d9da04eba0ea', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.285 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-5f0cb25f-e3ca-4a1a-8ae9-af922ff0c4fc', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.394 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-648d0342-1ba6-49c4-ba72-30b60c34b1b4', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.479 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-a0c56ceb-3f55-4eff-a9a6-edf13701cbee', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.567 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-d9c1a496-6dd0-493b-8fe1-832b366ee3ea', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.649 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-db0f74a5-93ad-4d68-afd3-c7997f491da3', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.756 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-e16a6f05-6ee1-4d73-9fc1-b9be05dda244', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.871 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-2380b677-61a9-47a2-a7d7-36f758c635f6', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:02.974 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-1709b29c-00ec-4c42-8f73-7a2dd989ffb9', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:03.077 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-3acec64b-6d5f-474d-be15-60d978415edc', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:03.173 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-e4ff7a5c-35db-49b7-9ac3-80623bc260e5', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:03.276 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-e754144b-9222-4b57-bf9b-670bc2b5d240', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:03.391 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-6b2eb378-9a84-4c35-965f-e5cd47b9fcf3', 'type': 'node_profile', 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'} 01/16/2025 00:54:03.487 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-f90a3c4a-8779-45ff-aee7-0ae4bdb22856', 'type': 'node_profile', 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'} 01/16/2025 00:54:03.503 7f984513c4e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:03.504 7f984513c4e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:03.504 7f984513c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:03.504 7f984513c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:03.504 7f984513c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:03.504 7f984513c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:03.504 7f984513c4e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:03.505 7f984513c4e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:03.578 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-71067b47-a865-4c3c-b719-980551cb5a91', 'type': 'node_profile', 'uuid': 'e234893d-56e3-48be-9871-542d7c7261f7'} 01/16/2025 00:54:03.675 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-cedcf2c2-10f0-44dd-a1f0-5b2c82ea98e9', 'type': 'node_profile', 'uuid': 'e234893d-56e3-48be-9871-542d7c7261f7'} 01/16/2025 00:54:03.788 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-9ef537b1-6bb4-49af-a36f-19103ffc6aca', 'type': 'node_profile', 'uuid': 'e234893d-56e3-48be-9871-542d7c7261f7'} 01/16/2025 00:54:03.852 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-e8e0cf02-afd9-4aaa-ac12-51bdade1297d', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:03.947 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-921f3b36-893d-440b-ac1e-7a3636159f8b', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:04.059 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-7b5e1b4f-7ac5-4bbe-8508-ba171ffaa7b5', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:04.151 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-fcb6ef25-761a-4257-a1ac-ca313c003e4a', 'type': 'node_profile', 'uuid': '7d37b8a5-98f1-49df-9c1b-3c81680708fe'} 01/16/2025 00:54:04.240 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-ba36c136-84a1-4bd4-a1c1-47c88ebb5500', 'type': 'node_profile', 'uuid': '7d37b8a5-98f1-49df-9c1b-3c81680708fe'} 01/16/2025 00:54:04.337 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-132358e5-6e69-4a16-b996-427ecc33d948', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:04.426 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-9cbd3593-bf48-4af3-b87c-c34cafc24e4e', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:04.521 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-2f7ba330-2611-472b-8704-57bab9e856a9', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:04.608 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-6ddb743d-5612-47be-9d60-266f0d301663', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:04.695 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-3c890d62-61f0-4bea-9bd3-0c566d2fb80b', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:04.783 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-b5e8e300-2f42-47df-8064-51e8fde1343a', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:04.874 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-8d20cc1e-1e86-47ab-84c6-adaa58628b20', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:04.970 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a82fed6f-bfe3-4e24-8496-7bd6ae3ce451', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.061 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-b0f62497-b672-4444-9d5a-dd064ae77c47', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.149 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-88da8d14-0aab-4329-81f7-e64645cc9d38', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.236 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-d443c378-c15f-42b4-a78c-ebf1a9a17c1b', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.321 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-1efc338f-fd69-4bad-8ea9-0299143b43db', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.404 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-8a96d9b7-d1e9-41b0-aa33-e0dc030f7839', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.489 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-495721b5-b7ef-47d9-a49a-9cbeeffd208d', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.571 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-59566fe8-6582-44e7-a82d-94b21e54f582', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.660 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-f78df404-ead4-4869-9291-c3f940bb1dab', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.744 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-2ad7869c-7829-409e-a795-1168779f48c6', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.831 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-a018e237-e125-4667-9fa4-f6d37cc5dbf4', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:05.916 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-53151633-a342-46b9-8d19-3c9eb2075048', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:06.023 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-f2bef8fd-039a-4494-85a3-9b4e5c15efa5', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.105 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-d8013126-d35e-4f6b-86d5-b8df107b9b15', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.192 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-edad87ed-83c6-4ca3-8db0-6e8300e193b0', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.275 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-1a36d989-fe55-4d5c-807b-274644be861d', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.367 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-5d8caa15-d0dd-47c4-bb75-b5f1b54666ce', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.455 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-3ac53ac8-0b27-4a6b-a5db-bf30eb778fe5', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.555 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-b73d49cd-8fd9-4241-a5d7-bda645d45f86', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.645 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-51a9cd3e-953c-4532-8bc9-0e2b56ef6529', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.740 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-605e4681-f87c-46cc-b0c0-5173c2a5c867', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:06.848 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-dd2b4728-02f7-4eb7-b6a0-521aa5c6b749', 'type': 'node_profile', 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'} 01/16/2025 00:54:06.952 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-6cd9cdf3-f3cf-488e-977b-0ada4128b025', 'type': 'node_profile', 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'} 01/16/2025 00:54:07.055 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-d4de6dc0-c4fc-44d5-9f88-d7a9ee7b8f2c', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:07.148 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k-lean'], 'oper': 'UPDATE', 'request-id': 'req-ae5bffe4-3c66-4581-8c5f-ba79a0d42e22', 'type': 'node_profile', 'uuid': '56af72da-9513-403f-b908-7be5f47aa31c'} 01/16/2025 00:54:07.243 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5k'], 'oper': 'UPDATE', 'request-id': 'req-18863619-ed64-4d1d-a6df-0da15d8c8ac8', 'type': 'node_profile', 'uuid': '0b175e25-632f-4246-b45e-3c4e20053e0c'} 01/16/2025 00:54:07.340 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5120'], 'oper': 'UPDATE', 'request-id': 'req-83fd3c02-263b-4faf-bff3-f31cd5799ce8', 'type': 'node_profile', 'uuid': 'e234893d-56e3-48be-9871-542d7c7261f7'} 01/16/2025 00:54:07.429 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx5220'], 'oper': 'UPDATE', 'request-id': 'req-26c71bc9-47e2-4d7b-ae64-9f3bf924432f', 'type': 'node_profile', 'uuid': '7d37b8a5-98f1-49df-9c1b-3c81680708fe'} 01/16/2025 00:54:07.504 7f9844e0a0f0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:07.506 7f9844e0a0f0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:07.506 7f9844e0a0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:07.506 7f9844e0a0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:07.507 7f9844e0a0f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:07.508 7f9844e0a0f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:07.508 7f9844e0a0f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:07.526 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k-lean'], 'oper': 'UPDATE', 'request-id': 'req-abb56f04-ce94-4e65-b982-10a9548e0498', 'type': 'node_profile', 'uuid': 'd38c38dc-01d6-4686-9569-94c9abfe6045'} 01/16/2025 00:54:07.630 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-qfx10k'], 'oper': 'UPDATE', 'request-id': 'req-8a2d2947-d108-490d-8e2e-2b177c0003bc', 'type': 'node_profile', 'uuid': '84ddb870-b247-4199-afac-77ec6e4cd9c9'} 01/16/2025 00:54:07.749 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-mx'], 'oper': 'UPDATE', 'request-id': 'req-f4a82f5d-0586-49b1-9787-777675907e95', 'type': 'node_profile', 'uuid': '5f0c60ed-993c-4c88-b453-b4a18e273597'} 01/16/2025 00:54:07.800 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'juniper-srx'], 'oper': 'UPDATE', 'request-id': 'req-0243c56f-6a86-486f-af43-43abfa98a029', 'type': 'node_profile', 'uuid': '6e8be416-d089-4efd-a2b9-71114f5d6d2d'} 01/16/2025 00:54:07.923 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-1'], 'oper': 'UPDATE', 'request-id': 'req-c447ab3e-ecea-47de-bf87-e0d238cc53c2', 'type': 'telemetry_profile', 'uuid': '00a20e2f-75a3-4699-8c84-cae7f34608bb'} 01/16/2025 00:54:07.977 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-2'], 'oper': 'UPDATE', 'request-id': 'req-b5edf907-d4de-44c1-92c0-5616aad5a693', 'type': 'telemetry_profile', 'uuid': '43b1a0a7-4ba9-4250-b9c6-cf3e33849ef7'} 01/16/2025 00:54:08.087 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-3'], 'oper': 'UPDATE', 'request-id': 'req-1a778fd2-c925-4473-a1c4-7a3cbcee2cf1', 'type': 'telemetry_profile', 'uuid': 'c40d1c50-e7c1-48c7-bd24-49c60b9525d2'} 01/16/2025 00:54:08.192 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-4'], 'oper': 'UPDATE', 'request-id': 'req-c335d152-8794-400a-9ddd-adc82a4bd4ed', 'type': 'telemetry_profile', 'uuid': '47796a68-8257-46d9-a101-90a9da2cb829'} 01/16/2025 00:54:08.288 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-5'], 'oper': 'UPDATE', 'request-id': 'req-da689042-d05d-45c0-b3b9-bb8eb1217d90', 'type': 'telemetry_profile', 'uuid': '64758349-c4eb-4327-8e3a-bc86fda7cbbd'} 01/16/2025 00:54:08.386 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-telemetry-profile-6'], 'oper': 'UPDATE', 'request-id': 'req-27a0607e-b30a-4feb-9101-a510cd2549ac', 'type': 'telemetry_profile', 'uuid': 'bc6b72eb-9f13-424d-a0db-c412b32d3cfa'} 01/16/2025 00:54:08.476 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L2-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-64b36921-1c14-4b57-99e8-ed26a21d59b4', 'type': 'device_functional_group', 'uuid': '302e7e12-7302-4cf4-aa3f-bc5a7637f6f6'} 01/16/2025 00:54:08.601 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Storage-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-bc7b544d-0937-48e7-978f-6d8d179ba7d5', 'type': 'device_functional_group', 'uuid': 'ba72879c-35b2-474c-a53a-ef7c17304696'} 01/16/2025 00:54:08.707 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Gateway-Spine'], 'oper': 'UPDATE', 'request-id': 'req-c047fda8-10c5-40bb-af07-9cfb0adf6a5a', 'type': 'device_functional_group', 'uuid': '47864bed-49a2-4676-a569-94d7326cc776'} 01/16/2025 00:54:08.800 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf-with-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-08ff15f2-6bfb-4ec1-aa10-44f3e6fbd08d', 'type': 'device_functional_group', 'uuid': 'e842cc96-9e4b-4ecb-8202-3bd3de522cd7'} 01/16/2025 00:54:08.883 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine'], 'oper': 'UPDATE', 'request-id': 'req-075ee9f8-d6ea-4a61-98ef-3e2d98c70689', 'type': 'device_functional_group', 'uuid': '7a7fbbe4-9392-4436-9a6c-6d209f77ffae'} 01/16/2025 00:54:08.972 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Centrally-Routed-Border-Spine-With-Optimized-Multicast'], 'oper': 'UPDATE', 'request-id': 'req-fce7ffbf-ae5a-4308-8320-c8a362267426', 'type': 'device_functional_group', 'uuid': '9da08344-dc91-407b-812f-3dd415b208e1'} 01/16/2025 00:54:09.062 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Spine-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-38798c4b-f177-474e-bd72-3ef45fdb1575', 'type': 'device_functional_group', 'uuid': '7fa7033c-4f69-476d-8536-c1fa83cf2db1'} 01/16/2025 00:54:09.153 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Border-Leaf-in-Edge-Routed'], 'oper': 'UPDATE', 'request-id': 'req-bd390074-5f65-4c25-9848-a6ee1c41cbe4', 'type': 'device_functional_group', 'uuid': '1aae6eea-afb4-43a3-a26d-6e22443f8ac1'} 01/16/2025 00:54:09.253 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'L3-Server-Leaf'], 'oper': 'UPDATE', 'request-id': 'req-6f106410-9a75-4c67-a20f-48aff770c5cc', 'type': 'device_functional_group', 'uuid': '36a6f24e-ec58-4540-966f-03aa8c387542'} 01/16/2025 00:54:09.346 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'Lean-Spine-with-Route-Reflector'], 'oper': 'UPDATE', 'request-id': 'req-9b9f3c3d-68b6-4766-a07e-8015f7be75b7', 'type': 'device_functional_group', 'uuid': 'cafcb852-60a7-4c69-8f07-ece24cc09d91'} 01/16/2025 00:54:09.402 7f9844f880f0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = network_ipam identifier_name = default-domain:default-project:_internal_ipam_ipv6_link_local url = http://10.0.0.43:8082/network-ipams operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-device-manager remote_ip = 10.0.0.23 body = {"network-ipam": {"uuid": null, "fq_name": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "parent_type": "project", "ipam_subnet_method": "user-defined-subnet", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "_internal_ipam_ipv6_link_local"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:54:09.454 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_ipam_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'id_perms': {'created': '2025-01-16T00:54:09.439346', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:54:09.439346', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10349794088112641435, 'uuid_mslong': 9806372023592831556}}, 'ipam_subnet_method': 'user-defined-subnet', 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '88173b66-2994-4a44-8fa1-dae33864559b'}, 'oper': 'CREATE', 'request-id': 'req-c97ad2d3-a450-4053-bf3f-c3019c0ca6c9', 'type': 'network_ipam', 'uuid': '88173b66-2994-4a44-8fa1-dae33864559b'} 01/16/2025 00:54:09.594 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'obj_dict': {'address_allocation_mode': 'user-defined-subnet-only', 'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-01-16T00:54:09.560989', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:54:09.560989', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9946839445389806245, 'uuid_mslong': 3787491143534070080}}, 'is_shared': False, 'network_ipam_refs': [{'attr': {'host_routes': None, 'ipam_subnets': [{'addr_from_start': True, 'alloc_unit': 1, 'allocation_pools': [], 'created': None, 'default_gateway': 'fe80::1', 'dhcp_option_list': None, 'dhcp_relay_server': [], 'dns_nameservers': [], 'dns_server_address': 'fe80::2', 'enable_dhcp': True, 'host_routes': None, 'last_modified': None, 'subnet': {'ip_prefix': 'fe80::', 'ip_prefix_len': 64}, 'subnet_name': None, 'subnet_uuid': '64f8584a-d3a4-11ef-be29-fa163e47eaee', 'subscriber_tag': None, 'vlan_tag': None}]}, 'to': ['default-domain', 'default-project', '_internal_ipam_ipv6_link_local'], 'uuid': '88173b66-2994-4a44-8fa1-dae33864559b'}], 'parent_type': 'project', 'parent_uuid': '2343f136-f3cb-48ac-961a-ca63e69e24ca', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '348fdf20-c849-4940-8a0a-45c6644d8aa5', 'virtual_network_network_id': 5}, 'oper': 'CREATE', 'request-id': 'req-a7c94ee7-1a49-4714-8c1b-ac200644608a', 'type': 'virtual_network', 'uuid': '348fdf20-c849-4940-8a0a-45c6644d8aa5'} 01/16/2025 00:54:09.595 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectVNTable:ContrailConfigTrace] map 01/16/2025 00:54:09.595 7f98451d70f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:09.595 7f98451d70f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = default-domain:default-project:_internal_vn_ipv6_link_local elements = { address_allocation_mode : "user-defined-subnet-only"display_name : "_internal_vn_ipv6_link_local"fq_name : ["default-domain", "default-project", "_internal_vn_ipv6_link_local"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 3787491143534070080, "uuid_lslong": 9946839445389806245}, "enable": true, "created": "2025-01-16T00:54:09.560989", "last_modified": "2025-01-16T00:54:09.560989", "description": null, "user_visible": true, "creator": null}is_shared : falsenetwork_ipam_refs : [{"to": ["default-domain", "default-project", "_internal_ipam_ipv6_link_local"], "attr": {"ipam_subnets": [{"subnet": {"ip_prefix": "fe80::", "ip_prefix_len": 64}, "default_gateway": "fe80::1", "dns_server_address": "fe80::2", "subnet_uuid": "64f8584a-d3a4-11ef-be29-fa163e47eaee", "enable_dhcp": true, "dns_nameservers": [], "allocation_pools": [], "addr_from_start": true, "dhcp_option_list": null, "host_routes": null, "subnet_name": null, "alloc_unit": 1, "created": null, "last_modified": null, "subscriber_tag": null, "vlan_tag": null, "dhcp_relay_server": []}], "host_routes": null}, "uuid": "88173b66-2994-4a44-8fa1-dae33864559b"}]parent_type : "project"parent_uuid : "2343f136-f3cb-48ac-961a-ca63e69e24ca"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "348fdf20-c849-4940-8a0a-45c6644d8aa5"virtual_network_network_id : 5 } deleted = False >> 01/16/2025 00:54:09.595 7f98451d70f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:09.665 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'obj_dict': {'display_name': '_internal_vn_ipv6_link_local', 'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'id_perms': {'created': '2025-01-16T00:54:09.653950', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:54:09.653950', 'permissions': {'group': 'admin', 'group_access': 7, 'other_access': 7, 'owner': 'contrail-api', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11519217870069872184, 'uuid_mslong': 59834194814190799}}, 'parent_type': 'virtual-network', 'parent_uuid': '348fdf20-c849-4940-8a0a-45c6644d8aa5', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'routing_instance_fabric_snat': False, 'routing_instance_has_pnf': False, 'routing_instance_is_default': True, 'uuid': '00d492e2-1752-44cf-9fdc-7b9f13d8b638'}, 'oper': 'CREATE', 'request-id': 'req-a7c94ee7-1a49-4714-8c1b-ac200644608a', 'type': 'routing_instance', 'uuid': '00d492e2-1752-44cf-9fdc-7b9f13d8b638'} 01/16/2025 00:54:09.740 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['target:64512:8000004'], 'obj_dict': {'display_name': 'target:64512:8000004', 'fq_name': ['target:64512:8000004'], 'id_perms': {'created': '2025-01-16T00:54:09.715890', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:54:09.715890', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12187069013910272775, 'uuid_mslong': 18102122650448315990}}, 'perms2': {'global_access': 0, 'owner': '52d02cefd9d044d58eec4786b30f7bd4', 'owner_access': 7, 'share': []}, 'uuid': 'fb37a8a4-3486-4656-a921-2ab2c34abb07'}, 'oper': 'CREATE', 'request-id': 'req-908432ac-5d62-42d8-9ed9-a77bb85f2b6e', 'type': 'route_target', 'uuid': 'fb37a8a4-3486-4656-a921-2ab2c34abb07'} 01/16/2025 00:54:09.808 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', '_internal_vn_ipv6_link_local', '_internal_vn_ipv6_link_local'], 'oper': 'UPDATE', 'request-id': 'req-67db9532-1411-4c0f-9144-6e30ef39a28c', 'type': 'routing_instance', 'uuid': '00d492e2-1752-44cf-9fdc-7b9f13d8b638'} 01/16/2025 00:54:11.506 7f9844d3fb70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:11.508 7f9844d3fb70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:11.508 7f9844d3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:11.508 7f9844d3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:11.508 7f9844d3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:11.508 7f9844d3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:11.508 7f9844d3fb70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:11.509 7f9844d3fb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:15.509 7f9844e5e828 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:15.510 7f9844e5e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:15.511 7f9844e5e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:15.511 7f9844e5e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:15.511 7f9844e5e828 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:15.511 7f9844e5e828 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:15.511 7f9844e5e828 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:19.510 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:19.513 7f9844f11cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:19.513 7f9844f11cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:19.513 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:19.513 7f9844f11cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:19.513 7f9844f11cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:19.513 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:19.514 7f9844f11cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:23.514 7f9844f8fac8 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:23.516 7f9844f8fac8 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:23.516 7f9844f8fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:23.516 7f9844f8fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:23.517 7f9844f8fac8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:27.517 7f9844f55240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:27.518 7f9844f55240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:27.518 7f9844f55240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:27.518 7f9844f55240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:27.519 7f9844f55240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:31.519 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:31.520 7f9844f11cc0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:31.520 7f9844f11cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:31.520 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:31.520 7f9844f11cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:31.520 7f9844f11cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:31.520 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:31.521 7f9844f11cc0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:35.521 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:35.522 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:35.522 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:35.522 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:35.523 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:35.523 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:35.523 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:35.523 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:35.523 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:35.524 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:35.524 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:35.524 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:35.524 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:35.524 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:39.523 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:39.524 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:39.524 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:39.524 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:39.524 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:39.524 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:39.524 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:39.525 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:43.524 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:43.526 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:43.526 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:43.526 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:43.526 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:43.526 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:43.526 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:43.527 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:47.527 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:47.529 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:47.530 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:47.530 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:47.530 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:47.530 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:47.530 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:47.531 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:51.531 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:51.532 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:51.532 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:51.532 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:51.533 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:55.533 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:55.534 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:55.534 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:55.534 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:55.535 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:59.535 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:54:59.537 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:54:59.537 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:54:59.537 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:59.537 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:54:59.537 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:54:59.537 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:54:59.538 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:03.539 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:03.540 7f9844df5a20 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:03.541 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:03.541 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:03.541 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:03.541 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:03.541 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:03.542 7f9844df5a20 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:03.542 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:03.543 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:03.543 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:03.543 7f9844df5a20 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:03.543 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:03.543 7f9844df5a20 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.227 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2646-3 url = http://10.0.0.43:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.23 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-3"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.261 7f98450856d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2646-2 url = http://10.0.0.43:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.29 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-2"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.267 7f9844e12ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2646-1 url = http://10.0.0.43:8082/bgp-routers operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.43 body = {"bgp-router": {"uuid": null, "fq_name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"], "parent_type": "routing-instance", "bgp_router_parameters": {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.27", "address": "10.20.0.27", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}, "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-1"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.281 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-3'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.5', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.5', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-3', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-3'], 'id_perms': {'created': '2025-01-16T00:55:06.265337', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:55:06.265337', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9377276213756906292, 'uuid_mslong': 4513042020982999520}}, 'parent_type': 'routing-instance', 'parent_uuid': '821eadb7-8646-472f-b26e-133407e7cbf1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3ea18bce-951a-49e0-8222-c70891b34b34'}, 'oper': 'CREATE', 'request-id': 'req-84d53b58-27c7-4f19-887e-f5a444e3e73a', 'type': 'bgp_router', 'uuid': '3ea18bce-951a-49e0-8222-c70891b34b34'} 01/16/2025 00:55:06.281 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:55:06.282 7f9845f0cf60 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.282 7f9845f0cf60 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2646-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4513042020982999520, "uuid_lslong": 9377276213756906292}, "enable": true, "created": "2025-01-16T00:55:06.265337", "last_modified": "2025-01-16T00:55:06.265337", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "3ea18bce-951a-49e0-8222-c70891b34b34" } deleted = False >> 01/16/2025 00:55:06.282 7f9845f0cf60 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.341 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-2'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.6', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.6', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-2', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-2'], 'id_perms': {'created': '2025-01-16T00:55:06.324479', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:55:06.324479', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13307050869953845940, 'uuid_mslong': 2975605498777846027}}, 'parent_type': 'routing-instance', 'parent_uuid': '821eadb7-8646-472f-b26e-133407e7cbf1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '294b796f-8a5a-410b-b8ac-24432fa6dab4'}, 'oper': 'CREATE', 'request-id': 'req-b4e9b9eb-6387-4fc8-9cd1-2d70ae4c1a6e', 'type': 'bgp_router', 'uuid': '294b796f-8a5a-410b-b8ac-24432fa6dab4'} 01/16/2025 00:55:06.342 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:55:06.342 7f9844ee1b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.342 7f9844ee1b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2646-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2975605498777846027, "uuid_lslong": 13307050869953845940}, "enable": true, "created": "2025-01-16T00:55:06.324479", "last_modified": "2025-01-16T00:55:06.324479", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "294b796f-8a5a-410b-b8ac-24432fa6dab4" } deleted = False >> 01/16/2025 00:55:06.342 7f9844ee1b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.372 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-1'], 'obj_dict': {'bgp_router_parameters': {'address': '10.20.0.27', 'address_families': {'family': ['route-target', 'inet-vpn', 'e-vpn', 'erm-vpn', 'inet6-vpn']}, 'admin_down': False, 'auth_data': None, 'autonomous_system': 64512, 'cluster_id': None, 'gateway_address': None, 'hold_time': 0, 'identifier': '10.20.0.27', 'ipv6_gateway_address': None, 'local_autonomous_system': None, 'port': 179, 'router_type': 'control-node', 'source_port': None, 'vendor': 'contrail'}, 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-1', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-1'], 'id_perms': {'created': '2025-01-16T00:55:06.345274', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:55:06.345274', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12004907447907900742, 'uuid_mslong': 7664401809683530921}}, 'parent_type': 'routing-instance', 'parent_uuid': '821eadb7-8646-472f-b26e-133407e7cbf1', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6a5d6cd6-920c-44a9-a699-ffb819fddd46'}, 'oper': 'CREATE', 'request-id': 'req-29ac33a1-984f-4648-bed8-f29ae6707dbb', 'type': 'bgp_router', 'uuid': '6a5d6cd6-920c-44a9-a699-ffb819fddd46'} 01/16/2025 00:55:06.372 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:55:06.373 7f9844f73d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.373 7f9844f73d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.27", "address": "10.20.0.27", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}display_name : "cn-jenkins-deploy-platform-ansible-os-2646-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7664401809683530921, "uuid_lslong": 12004907447907900742}, "enable": true, "created": "2025-01-16T00:55:06.345274", "last_modified": "2025-01-16T00:55:06.345274", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6a5d6cd6-920c-44a9-a699-ffb819fddd46" } deleted = False >> 01/16/2025 00:55:06.373 7f9844f73d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.464 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.23 body = {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ref-uuid": "3ea18bce-951a-49e0-8222-c70891b34b34"} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.515 7f9844df5a20 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.23 body = {"type": "global-system-config", "uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ref-type": "bgp-router", "ref-uuid": "3ea18bce-951a-49e0-8222-c70891b34b34", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.520 7f98450856d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.29 body = {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ref-uuid": "294b796f-8a5a-410b-b8ac-24432fa6dab4"} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.559 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-05c7da41-db12-4ed8-b32f-2ac98b334d9a', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:55:06.581 7f98450856d8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.29 body = {"type": "global-system-config", "uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ref-type": "bgp-router", "ref-uuid": "294b796f-8a5a-410b-b8ac-24432fa6dab4", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.581 7f9844e12ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/ref-relax-for-delete operation = ref-relax-for-delete useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.43 body = {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ref-uuid": "6a5d6cd6-920c-44a9-a699-ffb819fddd46"} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.601 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-eee89e28-d769-42e7-a797-e657ca4ec184', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:55:06.631 7f9844e12ac8 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_control.py remote_ip = 10.0.0.43 body = {"type": "global-system-config", "uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ref-type": "bgp-router", "ref-uuid": "6a5d6cd6-920c-44a9-a699-ffb819fddd46", "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"], "operation": "ADD", "attr": null} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.672 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-ab025b30-85ee-48f5-93ff-f88bcc4db223', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:55:06.879 7f9844fcbcc0 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 294b796f-8a5a-410b-b8ac-24432fa6dab4 object_type = bgp_router identifier_name = default-domain:default-project:ip-fabric:__default__:cn-jenkins-deploy-platform-ansible-os-2646-2 url = http://10.0.0.43:8082/ref-update operation = ref-update useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-schema remote_ip = 10.0.0.23 body = {"type": "bgp-router", "uuid": "294b796f-8a5a-410b-b8ac-24432fa6dab4", "ref-type": "bgp-router", "ref-uuid": null, "ref-fq-name": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "operation": "ADD", "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}} domain = default-domain project = admin user = admin >> 01/16/2025 00:55:06.942 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-2'], 'oper': 'UPDATE', 'request-id': 'req-58135136-51ff-4fe6-a9b8-3b60596c422b', 'type': 'bgp_router', 'uuid': '294b796f-8a5a-410b-b8ac-24432fa6dab4'} 01/16/2025 00:55:06.955 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-58135136-51ff-4fe6-a9b8-3b60596c422b', 'type': 'bgp_router', 'uuid': '3ea18bce-951a-49e0-8222-c70891b34b34'} 01/16/2025 00:55:06.956 7f9844e3c048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.956 7f9844e3c048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "3ea18bce-951a-49e0-8222-c70891b34b34"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2646-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2975605498777846027, "uuid_lslong": 13307050869953845940}, "enable": true, "created": "2025-01-16T00:55:06.324479", "last_modified": "2025-01-16T00:55:06.924624", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "294b796f-8a5a-410b-b8ac-24432fa6dab4" } deleted = False >> 01/16/2025 00:55:06.956 7f9844e3c048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.967 7f9844f7e630 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:06.967 7f9844f7e630 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "294b796f-8a5a-410b-b8ac-24432fa6dab4"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2646-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4513042020982999520, "uuid_lslong": 9377276213756906292}, "enable": true, "created": "2025-01-16T00:55:06.265337", "last_modified": "2025-01-16T00:55:06.920447", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "3ea18bce-951a-49e0-8222-c70891b34b34" } deleted = False >> 01/16/2025 00:55:06.967 7f9844f7e630 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.067 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-1'], 'oper': 'UPDATE', 'request-id': 'req-22862af9-ff2e-48f1-b3c2-3530f10cefd6', 'type': 'bgp_router', 'uuid': '6a5d6cd6-920c-44a9-a699-ffb819fddd46'} 01/16/2025 00:55:07.081 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-3'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-22862af9-ff2e-48f1-b3c2-3530f10cefd6', 'type': 'bgp_router', 'uuid': '3ea18bce-951a-49e0-8222-c70891b34b34'} 01/16/2025 00:55:07.082 7f9844f7eb70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.082 7f9844f7eb70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.27", "address": "10.20.0.27", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "3ea18bce-951a-49e0-8222-c70891b34b34"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2646-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7664401809683530921, "uuid_lslong": 12004907447907900742}, "enable": true, "created": "2025-01-16T00:55:06.345274", "last_modified": "2025-01-16T00:55:07.048904", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6a5d6cd6-920c-44a9-a699-ffb819fddd46" } deleted = False >> 01/16/2025 00:55:07.082 7f9844f7eb70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.090 7f9850853eb8 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.090 7f9850853eb8 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-3 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.5", "address": "10.20.0.5", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "294b796f-8a5a-410b-b8ac-24432fa6dab4"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "6a5d6cd6-920c-44a9-a699-ffb819fddd46"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2646-3"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 4513042020982999520, "uuid_lslong": 9377276213756906292}, "enable": true, "created": "2025-01-16T00:55:06.265337", "last_modified": "2025-01-16T00:55:07.045466", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "3ea18bce-951a-49e0-8222-c70891b34b34" } deleted = False >> 01/16/2025 00:55:07.090 7f9850853eb8 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.125 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-1'], 'oper': 'UPDATE', 'request-id': 'req-2d177cfb-1ba7-41dd-a53e-13ecd5176d64', 'type': 'bgp_router', 'uuid': '6a5d6cd6-920c-44a9-a699-ffb819fddd46'} 01/16/2025 00:55:07.135 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-ansible-os-2646-2'], 'oper': 'UPDATE-IMPLICIT', 'request-id': 'req-2d177cfb-1ba7-41dd-a53e-13ecd5176d64', 'type': 'bgp_router', 'uuid': '294b796f-8a5a-410b-b8ac-24432fa6dab4'} 01/16/2025 00:55:07.136 7f9850853240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.136 7f9850853240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.27", "address": "10.20.0.27", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "294b796f-8a5a-410b-b8ac-24432fa6dab4"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "3ea18bce-951a-49e0-8222-c70891b34b34"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2646-1"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 7664401809683530921, "uuid_lslong": 12004907447907900742}, "enable": true, "created": "2025-01-16T00:55:06.345274", "last_modified": "2025-01-16T00:55:07.111971", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "6a5d6cd6-920c-44a9-a699-ffb819fddd46" } deleted = False >> 01/16/2025 00:55:07.136 7f9850853240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.143 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.143 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-2 elements = { bgp_router_parameters : {"admin_down": false, "vendor": "contrail", "cluster_id": null, "autonomous_system": 64512, "identifier": "10.20.0.6", "address": "10.20.0.6", "port": 179, "source_port": null, "hold_time": 0, "address_families": {"family": ["route-target", "inet-vpn", "e-vpn", "erm-vpn", "inet6-vpn"]}, "auth_data": null, "local_autonomous_system": null, "router_type": "control-node", "gateway_address": null, "ipv6_gateway_address": null}bgp_router_refs : [{"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-3"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "3ea18bce-951a-49e0-8222-c70891b34b34"}, {"to": ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-1"], "attr": {"session": [{"uuid": null, "attributes": [{"bgp_router": null, "admin_down": false, "passive": false, "as_override": false, "hold_time": 0, "loop_count": 0, "local_autonomous_system": 0, "address_families": {"family": []}, "auth_data": null, "family_attributes": [], "private_as_action": null, "route_origin_override": null}]}]}, "uuid": "6a5d6cd6-920c-44a9-a699-ffb819fddd46"}]display_name : "cn-jenkins-deploy-platform-ansible-os-2646-2"fq_name : ["default-domain", "default-project", "ip-fabric", "__default__", "cn-jenkins-deploy-platform-ansible-os-2646-2"]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 2975605498777846027, "uuid_lslong": 13307050869953845940}, "enable": true, "created": "2025-01-16T00:55:06.324479", "last_modified": "2025-01-16T00:55:07.108407", "description": null, "user_visible": true, "creator": null}parent_type : "routing-instance"parent_uuid : "821eadb7-8646-472f-b26e-133407e7cbf1"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "294b796f-8a5a-410b-b8ac-24432fa6dab4" } deleted = False >> 01/16/2025 00:55:07.143 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.541 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:07.543 7f9844f928d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:07.543 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:07.543 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:07.543 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:07.543 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:07.543 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:07.544 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:11.544 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:11.545 7f9844f928d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:11.546 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:11.547 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:11.547 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:11.547 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:11.547 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:15.546 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:15.548 7f9844f928d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:15.548 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:15.548 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:15.548 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:15.548 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:15.548 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:15.549 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:19.549 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:19.552 7f9844f928d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:19.553 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:19.553 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:19.553 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:19.554 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:19.554 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:19.555 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:19.555 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:19.555 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:19.556 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:19.556 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:19.556 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:19.557 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:23.552 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:23.554 7f9844f928d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:23.554 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:23.554 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:23.554 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:23.555 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:23.555 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:23.555 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:23.555 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:23.555 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:23.555 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:23.556 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:23.556 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:23.556 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:27.555 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:27.560 7f9844f928d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:27.560 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:27.560 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:27.561 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:27.561 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:27.561 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:27.561 7f9844f928d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:27.562 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:27.562 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:27.562 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:27.562 7f9844f928d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:27.562 7f9844f928d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:27.562 7f9844f928d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:31.561 7f9845e01e10 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:31.565 7f9845e01e10 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:31.566 7f9845e01e10 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:31.566 7f9845e01e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:31.566 7f9845e01e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:31.567 7f9845e01e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:31.567 7f9845e01e10 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:31.568 7f9845e01e10 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:31.569 7f9845e01e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:31.569 7f9845e01e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:31.569 7f9845e01e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:31.573 7f9845e01e10 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:31.573 7f9845e01e10 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:31.573 7f9845e01e10 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:35.566 7f9844ea78d0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:35.568 7f9844ea78d0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:35.568 7f9844ea78d0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:35.568 7f9844ea78d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:35.568 7f9844ea78d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:35.568 7f9844ea78d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:35.568 7f9844ea78d0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:35.569 7f9844ea78d0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:39.569 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:39.572 7f9844f0c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:39.572 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:39.572 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:39.574 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:39.574 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:39.574 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:39.575 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:39.576 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:39.577 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:39.577 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:39.577 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:39.578 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:39.578 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:43.573 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:43.574 7f9844f0c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:43.574 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:43.574 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:43.575 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:47.575 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:47.576 7f9844f0c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:47.576 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:47.576 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:47.577 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:47.578 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:47.578 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:51.577 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:51.577 7f9844f0c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:51.578 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:51.579 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:51.579 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:55.579 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:55.581 7f9844f0c240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:55.581 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:55.581 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:55.581 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:55.581 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:55.581 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:55.582 7f9844f0c240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:59.582 7f9845085b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:55:59.583 7f9845085b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:55:59.584 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:55:59.584 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:59.584 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:55:59.584 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:55:59.584 7f9845085b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:55:59.585 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:03.584 7f9845085b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:03.585 7f9845085b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:03.585 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:03.585 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:03.586 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:03.586 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:03.586 7f9845085b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:03.586 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:03.586 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:03.587 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:03.587 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:03.587 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:03.587 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:03.587 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:07.586 7f9845085b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:07.589 7f9845085b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:07.589 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:07.589 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:07.589 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:07.589 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:07.589 7f9845085b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:07.590 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:07.590 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:07.591 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:07.591 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:07.591 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:07.591 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:07.591 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:11.589 7f9845085b70 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:11.591 7f9845085b70 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:11.592 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:11.592 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:11.592 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:11.592 7f9845085b70 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:11.592 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:11.592 7f9845085b70 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:14.833 7f9845085b70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-3. url = http://10.0.0.43:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.23 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-3."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.23", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-3."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:56:14.900 7f9844ebab70 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-1. url = http://10.0.0.43:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.43 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-1."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.43", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-1."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:56:14.909 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'obj_dict': {'database_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'id_perms': {'created': '2025-01-16T00:56:14.880542', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:56:14.880542', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10388389068655718969, 'uuid_mslong': 16951382534951946975}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eb3f689a-6f92-4adf-902a-f8d161c67239'}, 'oper': 'CREATE', 'request-id': 'req-34fc1c22-0ca1-48cb-86f3-82fff70161ac', 'type': 'database_node', 'uuid': 'eb3f689a-6f92-4adf-902a-f8d161c67239'} 01/16/2025 00:56:14.909 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:56:14.909 7f9844dc7588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:14.910 7f9844dc7588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-3. elements = { database_node_ip_address : "10.0.0.23"display_name : "cn-jenkins-deploy-platform-ansible-os-2646-3."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-3."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 16951382534951946975, "uuid_lslong": 10388389068655718969}, "enable": true, "created": "2025-01-16T00:56:14.880542", "last_modified": "2025-01-16T00:56:14.880542", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "22978d74-648d-4342-9707-c760fd7f98ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "eb3f689a-6f92-4adf-902a-f8d161c67239" } deleted = False >> 01/16/2025 00:56:14.910 7f9844dc7588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:14.911 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: NoSession] __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = database_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-2. url = http://10.0.0.43:8082/database-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_database_node.py remote_ip = 10.0.0.29 body = {"database-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-2."], "parent_type": "global-system-config", "database_node_ip_address": "10.0.0.29", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-2."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:56:15.009 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'obj_dict': {'database_node_ip_address': '10.0.0.43', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'id_perms': {'created': '2025-01-16T00:56:14.976597', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:56:14.976597', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12367999836824040159, 'uuid_mslong': 15544294456786371762}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd7b86d73-84d3-44b2-aba3-f652b7fc72df'}, 'oper': 'CREATE', 'request-id': 'req-371e9436-e3f7-48ac-80d3-b10501d424f0', 'type': 'database_node', 'uuid': 'd7b86d73-84d3-44b2-aba3-f652b7fc72df'} 01/16/2025 00:56:15.009 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:56:15.010 7f9844d830f0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.010 7f9844d830f0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. elements = { database_node_ip_address : "10.0.0.43"display_name : "cn-jenkins-deploy-platform-ansible-os-2646-1."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-1."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15544294456786371762, "uuid_lslong": 12367999836824040159}, "enable": true, "created": "2025-01-16T00:56:14.976597", "last_modified": "2025-01-16T00:56:14.976597", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "22978d74-648d-4342-9707-c760fd7f98ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "d7b86d73-84d3-44b2-aba3-f652b7fc72df" } deleted = False >> 01/16/2025 00:56:15.010 7f9844d830f0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.033 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'obj_dict': {'database_node_ip_address': '10.0.0.29', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'id_perms': {'created': '2025-01-16T00:56:14.988452', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:56:14.988452', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11526295004259956339, 'uuid_mslong': 15757270789541152174}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'daad124c-283d-45ae-9ff5-a03cc9463673'}, 'oper': 'CREATE', 'request-id': 'req-ae66d52a-7317-4bc2-a213-9f6ef3b71a8e', 'type': 'database_node', 'uuid': 'daad124c-283d-45ae-9ff5-a03cc9463673'} 01/16/2025 00:56:15.034 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:56:15.034 7f9844dc7588 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.035 7f9844dc7588 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] ContrailConfigTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-2. elements = { database_node_ip_address : "10.0.0.29"display_name : "cn-jenkins-deploy-platform-ansible-os-2646-2."fq_name : ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-2."]id_perms : {"permissions": {"owner": "admin", "owner_access": 7, "group": "heat_stack_owner", "group_access": 7, "other_access": 7}, "uuid": {"uuid_mslong": 15757270789541152174, "uuid_lslong": 11526295004259956339}, "enable": true, "created": "2025-01-16T00:56:14.988452", "last_modified": "2025-01-16T00:56:14.988452", "description": null, "user_visible": true, "creator": null}parent_type : "global-system-config"parent_uuid : "22978d74-648d-4342-9707-c760fd7f98ed"perms2 : {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}uuid : "daad124c-283d-45ae-9ff5-a03cc9463673" } deleted = False >> 01/16/2025 00:56:15.035 7f9844dc7588 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.593 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:15.595 7f9844fdb390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:15.595 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:15.595 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:15.596 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:19.597 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:19.598 7f9844fdb390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:19.598 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:19.598 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:19.598 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:19.598 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:19.598 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:19.599 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:23.599 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:23.601 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:23.602 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:23.602 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:23.602 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:23.602 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:23.602 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:23.602 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:27.601 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:27.602 7f9844fdb390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:27.603 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:27.604 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:27.604 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:27.604 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:31.603 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:31.605 7f9844fdb390 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:31.605 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:31.605 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:31.605 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:31.605 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:31.605 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:31.606 7f9844fdb390 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:35.605 7f9844d914e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:35.606 7f9844d914e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:35.606 7f9844d914e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:35.606 7f9844d914e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:35.607 7f9844d914e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:39.607 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:39.608 7f9844fb1240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:39.609 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:39.610 7f9844fb1240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:39.610 7f9844fb1240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:39.610 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:39.610 7f9844fb1240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:39.610 7f9844fb1240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:43.609 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:43.611 7f9844fb1240 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:43.611 7f9844fb1240 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:43.612 7f9844fb1240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:43.613 7f9844fb1240 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:43.613 7f9844fb1240 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:43.613 7f9844fb1240 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:47.612 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:47.614 7f9844ea24e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:47.614 7f9844ea24e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:47.614 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:47.615 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:47.615 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:47.615 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:47.615 7f9844ea24e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:47.616 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:47.616 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:47.616 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:47.616 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:47.616 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:47.616 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:51.615 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:51.616 7f9844ea24e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:51.616 7f9844ea24e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:51.617 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:51.617 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:51.617 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:51.617 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:51.618 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:55.618 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:55.619 7f9844ea24e0 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:55.619 7f9844ea24e0 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:55.620 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:55.620 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:55.620 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:55.620 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:55.621 7f9844ea24e0 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:59.620 7f9845486048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:56:59.622 7f9845486048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:56:59.622 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:56:59.622 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:59.622 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:56:59.622 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:56:59.623 7f9845486048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:56:59.623 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:56:59.624 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:59.624 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:56:59.624 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:59.624 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:56:59.624 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:56:59.624 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:03.623 7f9845486048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:57:03.624 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:57:03.625 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:03.625 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:57:03.625 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:03.625 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:03.625 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.43:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:57:03.625 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:07.624 7f9845486048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:57:07.625 7f9845486048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:57:07.625 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.29:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:57:07.626 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:07.627 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:07.627 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.29:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:57:07.627 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:11.626 7f9845486048 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:57:11.628 7f9845486048 [contrail-api] [ERROR]: Session Event: TCP Connect Fail 01/16/2025 00:57:11.628 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:57:11.628 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.23:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1.:Config:contrail-api:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8084 start_time = 1736988807473863 collector_name = collector_ip = 10.0.0.23:8086 collector_list = [ 10.0.0.29:8086, 10.0.0.23:8086, 10.0.0.43:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 3 >> 01/16/2025 00:57:11.629 7f9845486048 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/16/2025 00:57:15.629 7f9844d83d68 [contrail-api] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [INFO]: Session Event: TCP Connected 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-ansible-os-2646-1. process_status = [ << module_id = contrail-api instance_id = 0 state = Non-Functional connection_infos = [ << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.43:2181, 10.0.0.29:2181, 10.0.0.23:2181, ] status = Up description = >>, << type = Collector name = Collector server_addrs = [ 10.0.0.43:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.43:9041, 10.0.0.29:9041, 10.0.0.23:9041, ] status = Up description = >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.43:5673, 10.0.0.29:5673, 10.0.0.23:5673, ] status = Up description = >>, << type = Generic Connection name = Keystone server_addrs = [ http://10.0.0.43:5000/v3, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/16/2025 00:57:15.630 7f9844d83d68 [contrail-api] [DEBUG]: Send sandesh control message. uve type count # 19 01/16/2025 00:57:15.631 7f9844d83d68 [contrail-api] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/16/2025 00:57:15.631 7f9844d83d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 00:57:15.631 7f9844d83d68 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 00:57:15.631 7f9844f7ec18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/16/2025 00:57:15.632 7f9844f7ec18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/16/2025 00:57:17.095 7f9844da0e10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-2. url = http://10.0.0.43:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.29 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-2."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.29", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-2."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:17.102 7f9844dc78d0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-1. url = http://10.0.0.43:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.43 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-1."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.43", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-1."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:17.105 7f9844d4ab70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-3. url = http://10.0.0.43:8082/analytics-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_analytics_node.py remote_ip = 10.0.0.23 body = {"analytics-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-3."], "parent_type": "global-system-config", "analytics_node_ip_address": "10.0.0.23", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-3."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:17.173 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.29', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'id_perms': {'created': '2025-01-16T00:57:17.139080', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:17.139080', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12860226364564638075, 'uuid_mslong': 3152872497109551074}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '2bc140d4-dc50-47e2-b278-b3bdfefd097b'}, 'oper': 'CREATE', 'request-id': 'req-2c48b82b-224b-417c-8797-f8ad7cc03d9b', 'type': 'analytics_node', 'uuid': '2bc140d4-dc50-47e2-b278-b3bdfefd097b'} 01/16/2025 00:57:17.174 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:17.175 7f9844f34c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 00:57:17.184 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.43', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'id_perms': {'created': '2025-01-16T00:57:17.149121', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:17.149121', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12989567633272752670, 'uuid_mslong': 14597711981351747642}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ca957db4-7def-403a-b444-36f0d7224a1e'}, 'oper': 'CREATE', 'request-id': 'req-df52b944-9838-4ef7-9ab0-2bf3e82f370e', 'type': 'analytics_node', 'uuid': 'ca957db4-7def-403a-b444-36f0d7224a1e'} 01/16/2025 00:57:17.184 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:17.185 7f9844da7c18 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 00:57:17.210 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'obj_dict': {'analytics_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'id_perms': {'created': '2025-01-16T00:57:17.179925', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:17.179925', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13083894411625429544, 'uuid_mslong': 17298524979550307307}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'f010b4d1-4051-43eb-b593-54a55ba6fa28'}, 'oper': 'CREATE', 'request-id': 'req-3a728b7d-7eab-4e7f-9af0-01ae5c39d25d', 'type': 'analytics_node', 'uuid': 'f010b4d1-4051-43eb-b593-54a55ba6fa28'} 01/16/2025 00:57:17.211 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:17.214 7f9844dfb8d0 [contrail-api] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/16/2025 00:57:28.609 7f9844f7e588 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001016 01/16/2025 00:57:28.610 7f9844f7e588 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/16/2025 00:57:28.610 7f9844d3ff60 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 0 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.611 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.612 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.613 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.613 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:28.613 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 00:57:28.613 7f9844d3ff60 [contrail-api] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/16/2025 00:57:28.613 7f9844f88c18 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/16/2025 00:57:28.617 7f9844f88c18 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/16/2025 00:57:28.618 7f9844e3fb70 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/16/2025 00:57:28.622 7f9844e3fb70 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/16/2025 00:57:39.340 7f9844e0a198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-1. url = http://10.0.0.43:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.43 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-1."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.43", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-1."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:39.367 7f9844ea7cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-2. url = http://10.0.0.43:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.29 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-2."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.29", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-2."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:39.408 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.43', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'id_perms': {'created': '2025-01-16T00:57:39.379740', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:39.379740', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13401031202637362395, 'uuid_mslong': 1255001488023768173}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '116aa934-3e3e-4c6d-b9fa-06e0892034db'}, 'oper': 'CREATE', 'request-id': 'req-0ff2ba28-ee17-45f4-9b4f-74ade02282be', 'type': 'analytics_alarm_node', 'uuid': '116aa934-3e3e-4c6d-b9fa-06e0892034db'} 01/16/2025 00:57:39.409 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 01/16/2025 00:57:39.447 7f9844ea7cc0 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_alarm_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-3. url = http://10.0.0.43:8082/analytics-alarm-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_analytics_alarm_node.py remote_ip = 10.0.0.23 body = {"analytics-alarm-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-3."], "parent_type": "global-system-config", "analytics_alarm_node_ip_address": "10.0.0.23", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-3."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:39.456 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.29', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'id_perms': {'created': '2025-01-16T00:57:39.404685', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:39.404685', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11898687839266433963, 'uuid_mslong': 1592637898675929707}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '161a2fbb-0e67-426b-a520-a18c40bc6bab'}, 'oper': 'CREATE', 'request-id': 'req-580cda83-4f60-4616-8424-5ff8c44d1128', 'type': 'analytics_alarm_node', 'uuid': '161a2fbb-0e67-426b-a520-a18c40bc6bab'} 01/16/2025 00:57:39.456 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 01/16/2025 00:57:39.552 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'obj_dict': {'analytics_alarm_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'id_perms': {'created': '2025-01-16T00:57:39.511831', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:39.511831', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13612157922925712275, 'uuid_mslong': 6651862862675264300}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5c502a07-d05f-432c-bce8-1982b6819393'}, 'oper': 'CREATE', 'request-id': 'req-af307334-d52a-46a7-a5f5-7d8a2b2c334d', 'type': 'analytics_alarm_node', 'uuid': '5c502a07-d05f-432c-bce8-1982b6819393'} 01/16/2025 00:57:39.552 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.268 7f9844f7e588 [contrail-api] [DEBUG]: Extracted sandesh length: 0000001716 01/16/2025 00:57:41.268 7f9844f7e588 [contrail-api] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: Number of uve types in sandesh control message is 5 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:ModuleCpuStateTrace] map 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectApplicationPolicySetTable:ContrailConfigTrace] map 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectProjectTable:ContrailConfigTrace] map 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.269 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectTagTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectVNTable:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectBgpRouter:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectDatabaseInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.270 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.271 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.271 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectCollectorInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.271 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.271 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.271 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectAnalyticsAlarmInfo:ContrailConfigTrace] map 01/16/2025 00:57:41.271 7f9844d3ff60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/16/2025 00:57:41.271 7f9844f34390 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/16/2025 00:57:41.293 7f9844f34390 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/16/2025 00:57:41.294 7f984501a978 [contrail-api] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/16/2025 00:57:41.300 7f984501a978 [contrail-api] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/16/2025 00:57:53.789 7f9844ee1b70 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-1. url = http://10.0.0.43:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.43 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-1."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.43", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-1."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:53.894 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.43', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-1.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-1.'], 'id_perms': {'created': '2025-01-16T00:57:53.864373', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:53.864373', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12886924083119876159, 'uuid_mslong': 5763311014538200173}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '4ffb64d5-17a5-446d-b2d7-8d2cfdc9683f'}, 'oper': 'CREATE', 'request-id': 'req-48f7362e-6607-4810-a890-b071876681b9', 'type': 'analytics_snmp_node', 'uuid': '4ffb64d5-17a5-446d-b2d7-8d2cfdc9683f'} 01/16/2025 00:57:53.895 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 01/16/2025 00:57:54.337 7f9844dd8390 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-3. url = http://10.0.0.43:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.23 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-3."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.23", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-3."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:54.426 7f9844f21780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = analytics_snmp_node identifier_name = default-global-system-config:cn-jenkins-deploy-platform-ansible-os-2646-2. url = http://10.0.0.43:8082/analytics-snmp-nodes operation = post useragent = cn-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_analytics_snmp_node.py remote_ip = 10.0.0.29 body = {"analytics-snmp-node": {"uuid": null, "fq_name": ["default-global-system-config", "cn-jenkins-deploy-platform-ansible-os-2646-2."], "parent_type": "global-system-config", "analytics_snmp_node_ip_address": "10.0.0.29", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "cn-jenkins-deploy-platform-ansible-os-2646-2."}} domain = default-domain project = admin user = admin >> 01/16/2025 00:57:54.444 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.23', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-3.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-3.'], 'id_perms': {'created': '2025-01-16T00:57:54.411359', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:54.411359', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12276455036309359186, 'uuid_mslong': 6048722767998701149}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '53f1614f-5b61-4e5d-aa5e-bacfe4464a52'}, 'oper': 'CREATE', 'request-id': 'req-b515dcb3-2ae1-465f-80d6-e66c2bce4808', 'type': 'analytics_snmp_node', 'uuid': '53f1614f-5b61-4e5d-aa5e-bacfe4464a52'} 01/16/2025 00:57:54.445 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 01/16/2025 00:57:54.523 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'obj_dict': {'analytics_snmp_node_ip_address': '10.0.0.29', 'display_name': 'cn-jenkins-deploy-platform-ansible-os-2646-2.', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-ansible-os-2646-2.'], 'id_perms': {'created': '2025-01-16T00:57:54.499110', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:57:54.499110', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11101887040193823160, 'uuid_mslong': 14769472425524807280}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'ccf7b4eb-4355-4670-9a11-d371574401b8'}, 'oper': 'CREATE', 'request-id': 'req-50b90e50-e4f3-4c71-8814-c5b13eaee0bf', 'type': 'analytics_snmp_node', 'uuid': 'ccf7b4eb-4355-4670-9a11-d371574401b8'} 01/16/2025 00:57:54.525 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectAnalyticsSNMPInfo:ContrailConfigTrace] map 01/16/2025 00:59:54.444 7f9844eb2198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 22978d74-648d-4342-9707-c760fd7f98ed object_type = global_system_config identifier_name = default-global-system-config url = http://10.0.0.43:8082/global-system-config/22978d74-648d-4342-9707-c760fd7f98ed operation = http_put useragent = an-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.33 body = {"global-system-config": {"uuid": "22978d74-648d-4342-9707-c760fd7f98ed", "ip_fabric_subnets": {"subnet": [{"ip_prefix": "10.20.0.0", "ip_prefix_len": 24}]}}} domain = default-domain project = admin user = admin >> 01/16/2025 00:59:54.468 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-f39e9f6e-50f7-4d65-9d12-1d7b8c2852dd', 'type': 'global_system_config', 'uuid': '22978d74-648d-4342-9707-c760fd7f98ed'} 01/16/2025 00:59:54.567 7f9844fb1240 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2646-2 url = http://10.0.0.43:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.33 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2646-2"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.24", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-2646-2"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:59:54.606 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-2'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2646-2', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-2'], 'id_perms': {'created': '2025-01-16T00:59:54.597365', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:59:54.597365', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9508196493153674946, 'uuid_mslong': 7812083512600185300}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '6c6a1890-8438-49d4-83f3-e6557d0a26c2', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.24'}, 'oper': 'CREATE', 'request-id': 'req-c3a21e95-ad50-4e8b-a4e8-cfa565deef0a', 'type': 'virtual_router', 'uuid': '6c6a1890-8438-49d4-83f3-e6557d0a26c2'} 01/16/2025 00:59:54.607 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 01/16/2025 00:59:54.921 7f9844d91198 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2646-2:vhost0 url = http://10.0.0.43:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-2646-2:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.33 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2646-2", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "0678c6bd-5bfd-4b8a-8d00-0b438b2f5966"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 01/16/2025 00:59:54.975 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-2', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-2', 'vhost0'], 'id_perms': {'created': '2025-01-16T00:59:54.954527', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T00:59:54.954527', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13335249911922711153, 'uuid_mslong': 14007366754167898567}}, 'parent_type': 'virtual-router', 'parent_uuid': '6c6a1890-8438-49d4-83f3-e6557d0a26c2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c26429d9-44cb-41c7-b910-532447365a71', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:c2:64:29:d9:44']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '0678c6bd-5bfd-4b8a-8d00-0b438b2f5966'}]}, 'oper': 'CREATE', 'request-id': 'req-68f304e7-31d9-42bb-a97b-db5f0cc286ee', 'type': 'virtual_machine_interface', 'uuid': 'c26429d9-44cb-41c7-b910-532447365a71'} 01/16/2025 00:59:54.976 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 01/16/2025 00:59:55.006 7f9844f27a20 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = c26429d9-44cb-41c7-b910-532447365a71 object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2646-2:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 01/16/2025 00:59:55.049 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-2', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-68f304e7-31d9-42bb-a97b-db5f0cc286ee', 'type': 'virtual_machine_interface', 'uuid': 'c26429d9-44cb-41c7-b910-532447365a71'} 01/16/2025 00:59:55.542 7f9844d406d8 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = 1f1d2317-920f-473a-978b-e0a09ae1808d object_type = access_control_list identifier_name = default-domain:default-project:ip-fabric:ip-fabric url = http://10.0.0.43:8082/access-control-list/1f1d2317-920f-473a-978b-e0a09ae1808d operation = http_put useragent = cn-jenkins-deploy-platform-ansible-os-2646-3:/usr/bin/contrail-schema remote_ip = 10.0.0.23 body = {"access-control-list": {"uuid": "1f1d2317-920f-473a-978b-e0a09ae1808d", "access_control_list_entries": {"dynamic": false, "acl_rule": [{"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "default-domain:default-project:ip-fabric", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "deny", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000002", "direction": "<>"}, {"match_condition": {"protocol": "any", "src_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "src_port": {"start_port": 0, "end_port": 65535}, "dst_address": {"subnet": null, "virtual_network": "any", "security_group": null, "network_policy": null, "subnet_list": []}, "dst_port": {"start_port": 0, "end_port": 65535}, "ethertype": null}, "action_list": {"simple_action": "pass", "gateway_name": null, "apply_service": [], "service_properties": null, "mirror_to": null, "assign_routing_instance": null, "log": false, "alert": false, "qos_action": null, "host_based_service": false}, "rule_uuid": "00000000-0000-0000-0000-100000000001", "direction": null}]}, "access_control_list_hash": -3829811785878395678}} domain = default-domain project = admin user = admin >> 01/16/2025 00:59:55.565 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-ffd9618e-80d9-485c-a612-3297231af9b5', 'type': 'access_control_list', 'uuid': '1f1d2317-920f-473a-978b-e0a09ae1808d'} 01/16/2025 01:00:46.784 7f9844dfbe10 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_router identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2646-1 url = http://10.0.0.43:8082/virtual-routers operation = post useragent = an-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.32 body = {"virtual-router": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2646-1"], "parent_type": "global-system-config", "virtual_router_dpdk_enabled": false, "virtual_router_ip_address": "10.20.0.8", "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "an-jenkins-deploy-platform-ansible-os-2646-1"}} domain = default-domain project = admin user = admin >> 01/16/2025 01:00:46.828 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-1'], 'obj_dict': {'display_name': 'an-jenkins-deploy-platform-ansible-os-2646-1', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-1'], 'id_perms': {'created': '2025-01-16T01:00:46.808929', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T01:00:46.808929', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11648297938632170036, 'uuid_mslong': 10690037606337167446}}, 'parent_type': 'global-system-config', 'parent_uuid': '22978d74-648d-4342-9707-c760fd7f98ed', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '945aa490-914b-4056-a1a7-11428615da34', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.20.0.8'}, 'oper': 'CREATE', 'request-id': 'req-ae8fb6da-9290-49c9-a854-b3c1e1bc71c8', 'type': 'virtual_router', 'uuid': '945aa490-914b-4056-a1a7-11428615da34'} 01/16/2025 01:00:46.829 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectVRouter:ContrailConfigTrace] map 01/16/2025 01:00:47.125 7f9844e3c780 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2646-1:vhost0 url = http://10.0.0.43:8082/virtual-machine-interfaces operation = post useragent = an-jenkins-deploy-platform-ansible-os-2646-1:/opt/contrail/utils/provision_vrouter.py remote_ip = 10.0.0.32 body = {"virtual-machine-interface": {"uuid": null, "fq_name": ["default-global-system-config", "an-jenkins-deploy-platform-ansible-os-2646-1", "vhost0"], "parent_type": "virtual-router", "virtual_machine_interface_disable_policy": true, "virtual_network_refs": [{"to": ["default-domain", "default-project", "ip-fabric"], "uuid": "0678c6bd-5bfd-4b8a-8d00-0b438b2f5966"}], "id_perms": {"permissions": {"owner": "cloud-admin", "owner_access": 7, "group": "cloud-admin-group", "group_access": 7, "other_access": 7}, "uuid": null, "enable": true, "created": null, "last_modified": null, "description": null, "user_visible": true, "creator": null}, "perms2": {"owner": "cloud-admin", "owner_access": 7, "global_access": 0, "share": []}, "display_name": "vhost0"}} domain = default-domain project = admin user = admin >> 01/16/2025 01:00:47.171 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-1', 'vhost0'], 'id_perms': {'created': '2025-01-16T01:00:47.145756', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-16T01:00:47.145756', 'permissions': {'group': 'heat_stack_owner', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13224542864807814971, 'uuid_mslong': 16058644606708106739}}, 'parent_type': 'virtual-router', 'parent_uuid': '945aa490-914b-4056-a1a7-11428615da34', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'dedbc42f-fd14-45f3-b787-03ab3dcbe73b', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:de:db:c4:2f:fd']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '0678c6bd-5bfd-4b8a-8d00-0b438b2f5966'}]}, 'oper': 'CREATE', 'request-id': 'req-e1464bd0-69cc-4fa2-9657-bd62b578dbc6', 'type': 'virtual_machine_interface', 'uuid': 'dedbc42f-fd14-45f3-b787-03ab3dcbe73b'} 01/16/2025 01:00:47.174 7f984545e0f0 [contrail-api] [DEBUG]: Add uve in the [ObjectVMITable:ContrailConfigTrace] map 01/16/2025 01:00:47.205 7f9844f73978 [contrail-api] [INFO]: __default__ [SYS_INFO]: VncApiConfigLog: api_log = << identifier_uuid = dedbc42f-fd14-45f3-b787-03ab3dcbe73b object_type = virtual_machine_interface identifier_name = default-global-system-config:an-jenkins-deploy-platform-ansible-os-2646-1:vhost0 url = http://127.0.0.1/ref-update operation = ref-update domain = default-domain >> 01/16/2025 01:00:47.233 7f984545e0f0 [contrail-api] [DEBUG]: __default__ [SYS_DEBUG]: VncApiDebug: Notification Message: {'fq_name': ['default-global-system-config', 'an-jenkins-deploy-platform-ansible-os-2646-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e1464bd0-69cc-4fa2-9657-bd62b578dbc6', 'type': 'virtual_machine_interface', 'uuid': 'dedbc42f-fd14-45f3-b787-03ab3dcbe73b'} 01/16/2025 01:01:44.264 7f9844eaf8d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:01:44.276 7f9844eaf8d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:02:07.574 7f9844eaf8d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:02:07.578 7f9844eaf8d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:02:30.165 7f9844e06c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:02:30.170 7f9844e06c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:02:52.980 7f9844e06c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:02:52.984 7f9844e06c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:03:16.055 7f9844eecd68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:03:16.060 7f9844eecd68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:03:37.832 7f9844d932e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:03:37.838 7f9844e3c780 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:03:59.931 7f9844e52b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:03:59.944 7f9844e52b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:04:23.902 7f9844f7e6d8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:04:23.906 7f9844f7e6d8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:04:46.272 7f9844bd28d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:04:46.280 7f9844bd28d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:05:08.124 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:05:08.129 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:05:31.920 7f9844ed08d0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:05:31.928 7f9844ed08d0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:05:53.805 7f9844be8a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:05:53.809 7f9844be8a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:06:16.041 7f9844be8a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:06:16.048 7f9844be8a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:06:39.593 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:06:39.597 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:07:01.670 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:07:01.676 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:07:24.103 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:07:24.107 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:07:47.228 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:07:47.233 7f9844e06cc0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:08:09.770 7f9844e1dac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:08:09.774 7f9844e1dac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:08:32.254 7f9844e1ef60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:08:32.258 7f9844e1ef60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:08:55.164 7f9844e1ef60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:08:55.168 7f9844e1ef60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:09:18.375 7f9844b8cac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:09:18.387 7f9844c724e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:09:40.235 7f9844c72ac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:09:40.239 7f9844c72ac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:10:03.248 7f9844bd7198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:10:03.252 7f9844bd7198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:10:26.939 7f9844bd7198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:10:26.945 7f9844bd7198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:11:53.247 7f9844bc0198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:11:53.251 7f9844bc0198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:12:16.385 7f9844bc0198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:12:16.396 7f9844bc0198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:12:38.549 7f9844bc0e10 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:12:38.553 7f9844fdb390 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:13:01.779 7f9844fff2e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:13:01.783 7f9844fff2e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:13:24.484 7f9844fff2e8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:13:24.489 7f9844fff2e8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:13:46.380 7f9844bc3b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:13:46.384 7f9844bc3b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:14:08.890 7f9844c72a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:14:08.894 7f9844c72a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:14:31.510 7f9844c72a20 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:14:31.514 7f9844c72a20 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:14:53.475 7f9844ed2b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:14:53.479 7f9844ed2b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:15:16.703 7f9844bc0978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:15:16.708 7f9844bc0978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:15:39.170 7f9844bca828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:15:39.176 7f9844bca828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:16:01.167 7f9844bca828 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:16:01.171 7f9844bca828 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:16:24.384 7f9844b8cd68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:16:24.388 7f9844b8cd68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:16:47.224 7f9844cc7ac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:16:47.229 7f9844cc7ac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:17:09.508 7f9844cc7ac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:17:09.512 7f9844cc7ac8 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:17:32.765 7f9844cc7ac8 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:17:32.769 7f9844da7b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:17:56.090 7f9844da7b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:17:56.094 7f9844da7b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:18:18.432 7f9844da7b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:18:18.443 7f9844da7b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:18:41.892 7f9844b8cd68 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:18:41.896 7f9844b8cd68 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:19:04.705 7f9844dd8630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:19:04.709 7f9844dd8630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:19:27.330 7f9844dd8630 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:19:27.334 7f9844dd8630 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:19:50.435 7f9844ee1b70 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:19:50.439 7f9844ee1b70 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:20:13.218 7f9844b9e240 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:20:13.224 7f9844b9e240 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:20:35.048 7f9844bddc18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:20:35.052 7f9844bddc18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:20:57.938 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:20:57.943 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:21:20.922 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:21:20.926 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:21:43.051 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:21:43.055 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:22:05.349 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:22:05.353 7f9844b9e4e0 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:22:28.426 7f9844dd0978 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:22:28.430 7f9844dd0978 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:22:50.521 7f9844eecf60 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:22:50.526 7f9844eecf60 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:23:13.174 7f9844d68198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:23:13.178 7f9844d68198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:23:35.801 7f9844d68198 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:23:35.806 7f9844d68198 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:23:46.617 7f9844bc0438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:23:46.621 7f9844bc0438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:23:57.310 7f9844bc0438 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:23:57.315 7f9844bc0438 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/16/2025 01:25:38.203 7f9844d68c18 [contrail-api] [DEBUG]: send sync_uve in the [none:ConfigApiWorkerTrace] map 01/16/2025 01:25:38.209 7f9844d68c18 [contrail-api] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map