01/09/2025 02:16:45.543 7f274fd061c8 [contrail-schema] [INFO]: SANDESH: Logging: SYSLOG: [None] -> [LOG_LOCAL0] 01/09/2025 02:16:45.543 7f274fd061c8 [contrail-schema] [INFO]: SANDESH: Trace: PRINT: [None] -> [False] 01/09/2025 02:16:45.543 7f274fd061c8 [contrail-schema] [INFO]: SANDESH: Flow Logging: [None] -> [False] 01/09/2025 02:16:45.544 7f274d7190f0 [contrail-schema] [INFO]: Processing event[EvStart] in state[none] 01/09/2025 02:16:45.544 7f274d7190f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:16:45.544 7f274d7190f0 [contrail-schema] [DEBUG]: Add uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvStart] => State[none] -> State[Idle] 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-463-1:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 start_time = 1736389005544731 collector_name = collector_ip = collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 1 >> 01/09/2025 02:16:45.545 7f274d7190f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.644 7f274fd061c8 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.30:5673//'] 01/09/2025 02:16:45.664 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:16:45.665 7f274df66048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.665 7f274df66048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:16:45.665 7f274df66048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.665 7f274df66048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.666 7f274df66048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:16:45.667 7f274df66048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.679 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:16:45.680 7f274d17f048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.685 7f274d17f048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:16:45.685 7f274d17f048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.698 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/09/2025 02:16:45.699 7f274d166cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.699 7f274d166cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, ] description = Collector:Collector[none to Idle on EvStart], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:16:45.699 7f274d166cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.715 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/09/2025 02:16:45.715 7f274df66c18 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.717 7f274df66c18 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:16:45.717 7f274df66c18 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.734 7f274fd061c8 [contrail-schema] [DEBUG]: Removed remained AMQP queue 01/09/2025 02:16:45.741 7f274d1808d0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.742 7f274d1808d0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, ] description = Collector:Collector[none to Idle on EvStart], Zookeeper:Zookeeper[] connection down >>, ] >> 01/09/2025 02:16:45.742 7f274d1808d0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.757 7f274fd061c8 [contrail-schema] [WARNING]: Waiting to be elected as master... 01/09/2025 02:16:45.757 7f274d638630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.758 7f274d638630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, ] description = Collector:Collector[none to Idle on EvStart] connection down >>, ] >> 01/09/2025 02:16:45.758 7f274d638630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.798 7f274fd061c8 [contrail-schema] [WARNING]: Elected master Schema Transformer node. Initializing... 01/09/2025 02:16:45.798 7f274fd061c8 [contrail-schema] [INFO]: SANDESH: INTROSPECT IS ON: 0.0.0.0:8087 01/09/2025 02:16:45.805 7f274fd061c8 [contrail-schema] [DEBUG]: Add [config_updater.xml:/usr/local/lib/python3.6/site-packages/cfgm_common/uve/config_updater] to home page 01/09/2025 02:16:45.805 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_ConfigApiUpdateReq] 01/09/2025 02:16:45.808 7f274fd061c8 [contrail-schema] [DEBUG]: Add [greenlets.xml:/usr/local/lib/python3.6/site-packages/cfgm_common/uve/greenlets] to home page 01/09/2025 02:16:45.808 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_GreenletObjectReq] 01/09/2025 02:16:45.810 7f274fd061c8 [contrail-schema] [DEBUG]: Add [cpuinfo.xml:/usr/local/lib/python3.6/site-packages/cfgm_common/uve/nodeinfo/cpuinfo] to home page 01/09/2025 02:16:45.810 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_CpuLoadInfoReq] 01/09/2025 02:16:45.823 7f274fd061c8 [contrail-schema] [DEBUG]: Add [st_introspect.xml:/usr/local/lib/python3.6/site-packages/schema_transformer/sandesh/st_introspect] to home page 01/09/2025 02:16:45.824 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_VnList] 01/09/2025 02:16:45.824 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_RoutingInstanceList] 01/09/2025 02:16:45.825 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_ServiceChainList] 01/09/2025 02:16:45.825 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_StObjectReq] 01/09/2025 02:16:45.827 7f274fd061c8 [contrail-schema] [DEBUG]: Add [sandesh_alarm.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_alarm] to home page 01/09/2025 02:16:45.827 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmCacheRequest] 01/09/2025 02:16:45.828 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmTypesRequest] 01/09/2025 02:16:45.828 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshAlarmAckRequest] 01/09/2025 02:16:45.828 7f274fd061c8 [contrail-schema] [DEBUG]: Add [sandesh_ctrl.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_ctrl] to home page 01/09/2025 02:16:45.828 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlClientToServer] 01/09/2025 02:16:45.828 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshCtrlServerToClient] 01/09/2025 02:16:45.829 7f274fd061c8 [contrail-schema] [DEBUG]: Add [sandesh_trace.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_trace] to home page 01/09/2025 02:16:45.829 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceRequest] 01/09/2025 02:16:45.829 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferListRequest] 01/09/2025 02:16:45.829 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceEnableDisableReq] 01/09/2025 02:16:45.829 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufStatusReq] 01/09/2025 02:16:45.829 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshTraceBufferEnableDisableReq] 01/09/2025 02:16:45.830 7f274fd061c8 [contrail-schema] [DEBUG]: Add [sandesh_uve.xml:/usr/local/lib/python3.6/site-packages/pysandesh/gen_py/sandesh_uve] to home page 01/09/2025 02:16:45.830 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshMessageStatsReq] 01/09/2025 02:16:45.830 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsSet] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshLoggingParamsStatus] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsSet] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendingParamsStatus] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsSet] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsReset] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueParamsStatus] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueSet] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshSendQueueStatus] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_CollectorInfoRequest] 01/09/2025 02:16:45.832 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVEDSConfReq] 01/09/2025 02:16:45.833 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVECacheReq] 01/09/2025 02:16:45.833 7f274fd061c8 [contrail-schema] [DEBUG]: Add http request [/Snh_SandeshUVETypesReq] 01/09/2025 02:16:45.845 7f274c48b978 [contrail-schema] [ERROR]: Cannot write http_port 8087 to /tmp/contrail-schema.0.http_port 01/09/2025 02:16:45.845 7f274c48b978 [contrail-schema] [ERROR]: Starting Introspect on HTTP Port 8087 01/09/2025 02:16:45.845 7f274c48bb70 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.845 7f274c48bb70 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Initializing description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 01/09/2025 02:16:45.846 7f274c48bb70 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.867 7f274c377630 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:45.869 7f274c377630 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ , ] status = Down description = none to Idle on EvStart >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[none to Idle on EvStart], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 01/09/2025 02:16:45.869 7f274c377630 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:49.545 7f274c3b7780 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/09/2025 02:16:54.550 7f274c3b7780 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/09/2025 02:16:54.550 7f274c3b7780 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/09/2025 02:16:54.550 7f274c3b7780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:16:54.550 7f274c3b7780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 01/09/2025 02:16:54.550 7f274c3b7780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:16:54.550 7f274c3b7780 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Down description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], ApiServer:ApiServer[ApiServer] connection down >>, ] >> 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-463-1:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1736389005544731 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/09/2025 02:16:54.551 7f274c3b7780 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:57.937 7f274fd061c8 [contrail-schema] [WARNING]: VNCCassandra started with driver cql 01/09/2025 02:16:57.937 7f274fd061c8 [contrail-schema] [WARNING]: initializing cassandra cluster 01/09/2025 02:16:57.937 7f274fd061c8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster before create 01/09/2025 02:16:57.939 7f2748200390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:57.940 7f2748200390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/09/2025 02:16:57.940 7f2748200390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:57.940 7f2748200390 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:57.941 7f2748200390 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:16:57.941 7f2748200390 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:57.942 7f274fd061c8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster created 01/09/2025 02:16:58.024 7f274fd061c8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster DB connected 01/09/2025 02:16:58.026 7f274b9d3cc0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:58.026 7f274b9d3cc0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Initializing description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Zookeeper:Zookeeper[], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:16:58.029 7f274b9d3cc0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:58.035 7f274fd061c8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster init KS 01/09/2025 02:16:58.035 7f274b9d3828 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:58.037 7f274b9d3828 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:16:58.037 7f274b9d3828 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:16:58.081 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:16:58.198 7f274fd061c8 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace', created 01/09/2025 02:16:58.202 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:16:58.211 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:16:58.313 7f274fd061c8 [contrail-schema] [WARNING]: keyspace 'to_bgp_keyspace' fixed with replication {'class': 'SimpleStrategy', 'replication_factor': None} 01/09/2025 02:16:58.318 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:16:58.318 7f274fd061c8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster KS are ready 01/09/2025 02:16:58.485 7f274fd061c8 [contrail-schema] [WARNING]: CassandraDriverCQL.__init__Cluster CF are ready 01/09/2025 02:16:58.551 7f274b9760f0 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/09/2025 02:16:58.692 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:16:59.582 7f274fd061c8 [contrail-schema] [WARNING]: table 'route_target_table', created 01/09/2025 02:16:59.591 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:00.222 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:00.487 7f274fd061c8 [contrail-schema] [WARNING]: table 'route_target_table' fixed with properties {'gc_grace_seconds': 864000} 01/09/2025 02:17:00.497 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:00.642 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:01.332 7f274fd061c8 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table', created 01/09/2025 02:17:01.338 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:02.359 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:02.534 7f274fd061c8 [contrail-schema] [WARNING]: table 'service_chain_ip_address_table' fixed with properties {'gc_grace_seconds': 864000} 01/09/2025 02:17:02.539 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:02.824 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:03.187 7f274fd061c8 [contrail-schema] [WARNING]: table 'service_chain_table', created 01/09/2025 02:17:03.191 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:03.566 7f274b9760f0 [contrail-schema] [ERROR]: Session Event: TCP Connect Fail 01/09/2025 02:17:03.567 7f274b9760f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/09/2025 02:17:03.567 7f274b9760f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:03.567 7f274b9760f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:03.567 7f274b9760f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:03.567 7f274b9760f0 [contrail-schema] [INFO]: Processing event[EvTcpConnectFail] in state[Connect] 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnectFail] => State[Connect] -> State[Idle] 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Initializing description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:Cassandra[] connection down >>, ] >> 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] SandeshModuleClientTrace: data = << name = cn-jenkins-deploy-platform-juju-os-463-1:Config:contrail-schema:0 client_info = << status = Idle successful_connections = 0 pid = 1 http_port = 8087 start_time = 1736389005544731 collector_name = collector_ip = 10.0.0.30:8086 collector_list = [ 10.0.0.30:8086, ] >> sm_queue_count = 1 max_sm_queue_count = 2 >> 01/09/2025 02:17:03.568 7f274b9760f0 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:04.003 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:04.164 7f274fd061c8 [contrail-schema] [WARNING]: table 'service_chain_table' fixed with properties {'gc_grace_seconds': 864000} 01/09/2025 02:17:04.174 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:04.371 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:04.612 7f274fd061c8 [contrail-schema] [WARNING]: table 'service_chain_uuid_table', created 01/09/2025 02:17:04.626 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:04.857 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock acquired. Performing schema change... 01/09/2025 02:17:05.004 7f274fd061c8 [contrail-schema] [WARNING]: table 'service_chain_uuid_table' fixed with properties {'gc_grace_seconds': 864000} 01/09/2025 02:17:05.017 7f274fd061c8 [contrail-schema] [WARNING]: Zookeeper lock released. 01/09/2025 02:17:05.018 7f274e08e048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.018 7f274e08e048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/09/2025 02:17:05.018 7f274e08e048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.055 7f274fd061c8 [contrail-schema] [WARNING]: Initializing RabbitMQ connection, urls ['pyamqp://guest:guest@10.0.0.30:5673//'] 01/09/2025 02:17:05.057 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:05.057 7f274b98c198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.059 7f274b98c198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Initializing description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:05.060 7f274b98c198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.060 7f274b98c198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.060 7f274b98c198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:05.060 7f274b98c198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.084 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:05.090 7f274e08e048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.090 7f274e08e048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/09/2025 02:17:05.090 7f274e08e048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.094 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/09/2025 02:17:05.094 7f274b993198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.094 7f274b993198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:05.094 7f274b993198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.112 7f274fd061c8 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/09/2025 02:17:05.112 7f274b993198 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.112 7f274b993198 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/09/2025 02:17:05.113 7f274b993198 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.114 7f274e08e048 [contrail-schema] [WARNING]: RabbitMQ publish connection down 01/09/2025 02:17:05.115 7f274b993a20 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.115 7f274b993a20 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:05.116 7f274b993a20 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.144 7f274e08e048 [contrail-schema] [WARNING]: RabbitMQ publish connection ESTABLISHED 01/09/2025 02:17:05.144 7f274b978e10 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.144 7f274b978e10 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/09/2025 02:17:05.144 7f274b978e10 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:05.521 7f274fd061c8 [contrail-schema] [INFO]: GlobalSystemConfigST - REINIT Start 01/09/2025 02:17:05.528 7f274fd061c8 [contrail-schema] [INFO]: GlobalSystemConfigST - REINIT Complete 01/09/2025 02:17:05.528 7f274fd061c8 [contrail-schema] [INFO]: PhysicalRouterST - REINIT Start 01/09/2025 02:17:05.531 7f274fd061c8 [contrail-schema] [INFO]: PhysicalRouterST - REINIT Complete 01/09/2025 02:17:05.531 7f274fd061c8 [contrail-schema] [INFO]: BgpRouterST - REINIT Start 01/09/2025 02:17:05.549 7f274fd061c8 [contrail-schema] [INFO]: BgpRouterST - REINIT Complete 01/09/2025 02:17:05.549 7f274fd061c8 [contrail-schema] [INFO]: BgpvpnST - REINIT Start 01/09/2025 02:17:05.551 7f274fd061c8 [contrail-schema] [INFO]: BgpvpnST - REINIT Complete 01/09/2025 02:17:05.553 7f274fd061c8 [contrail-schema] [INFO]: LogicalRouterST - REINIT Start 01/09/2025 02:17:05.557 7f274fd061c8 [contrail-schema] [INFO]: LogicalRouterST - REINIT Complete 01/09/2025 02:17:06.316 7f274fd061c8 [contrail-schema] [INFO]: RouteTargetST - REINIT Start 01/09/2025 02:17:06.327 7f274fd061c8 [contrail-schema] [INFO]: RouteTargetST - REINIT Complete 01/09/2025 02:17:06.327 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 01/09/2025 02:17:06.328 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 01/09/2025 02:17:06.328 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 01/09/2025 02:17:06.328 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Start 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: VirtualNetworkST - REINIT Complete 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 01/09/2025 02:17:06.329 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 01/09/2025 02:17:06.511 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 01/09/2025 02:17:06.511 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 01/09/2025 02:17:06.663 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 01/09/2025 02:17:06.663 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 01/09/2025 02:17:06.835 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 01/09/2025 02:17:06.835 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 01/09/2025 02:17:06.835 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 01/09/2025 02:17:06.835 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Start 01/09/2025 02:17:06.959 7f274b98c0f0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:17:07.015 7f274fd061c8 [contrail-schema] [DEBUG]: RoutingInstanceST - REINIT Complete 01/09/2025 02:17:07.015 7f274fd061c8 [contrail-schema] [INFO]: NetworkPolicyST - REINIT Start 01/09/2025 02:17:07.017 7f274fd061c8 [contrail-schema] [INFO]: NetworkPolicyST - REINIT Complete 01/09/2025 02:17:07.018 7f274fd061c8 [contrail-schema] [INFO]: VirtualMachineInterfaceST - REINIT Start 01/09/2025 02:17:07.020 7f274fd061c8 [contrail-schema] [INFO]: VirtualMachineInterfaceST - REINIT Complete 01/09/2025 02:17:07.021 7f274fd061c8 [contrail-schema] [INFO]: VirtualPortGroupST - REINIT Start 01/09/2025 02:17:07.022 7f274fd061c8 [contrail-schema] [INFO]: VirtualPortGroupST - REINIT Complete 01/09/2025 02:17:07.024 7f274fd061c8 [contrail-schema] [INFO]: InstanceIpST - REINIT Start 01/09/2025 02:17:07.025 7f274fd061c8 [contrail-schema] [INFO]: InstanceIpST - REINIT Complete 01/09/2025 02:17:07.026 7f274fd061c8 [contrail-schema] [INFO]: FloatingIpST - REINIT Start 01/09/2025 02:17:07.028 7f274fd061c8 [contrail-schema] [INFO]: FloatingIpST - REINIT Complete 01/09/2025 02:17:07.028 7f274fd061c8 [contrail-schema] [INFO]: AliasIpST - REINIT Start 01/09/2025 02:17:07.030 7f274fd061c8 [contrail-schema] [INFO]: AliasIpST - REINIT Complete 01/09/2025 02:17:07.032 7f274fd061c8 [contrail-schema] [INFO]: RoutingPolicyST - REINIT Start 01/09/2025 02:17:07.035 7f274fd061c8 [contrail-schema] [INFO]: RoutingPolicyST - REINIT Complete 01/09/2025 02:17:07.036 7f274fd061c8 [contrail-schema] [INFO]: RouteAggregateST - REINIT Start 01/09/2025 02:17:07.038 7f274fd061c8 [contrail-schema] [INFO]: RouteAggregateST - REINIT Complete 01/09/2025 02:17:07.039 7f274fd061c8 [contrail-schema] [INFO]: PortTupleST - REINIT Start 01/09/2025 02:17:07.040 7f274fd061c8 [contrail-schema] [INFO]: PortTupleST - REINIT Complete 01/09/2025 02:17:07.040 7f274fd061c8 [contrail-schema] [INFO]: BgpAsAServiceST - REINIT Start 01/09/2025 02:17:07.042 7f274fd061c8 [contrail-schema] [INFO]: BgpAsAServiceST - REINIT Complete 01/09/2025 02:17:07.042 7f274fd061c8 [contrail-schema] [INFO]: RouteTableST - REINIT Start 01/09/2025 02:17:07.043 7f274fd061c8 [contrail-schema] [INFO]: RouteTableST - REINIT Complete 01/09/2025 02:17:07.043 7f274fd061c8 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.043 7f274fd061c8 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:__link_local__): Duration (0.000) sec 01/09/2025 02:17:07.044 7f274fd061c8 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.044 7f274fd061c8 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:dci-network): Duration (0.000) sec 01/09/2025 02:17:07.044 7f274fd061c8 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.044 7f274fd061c8 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:default-virtual-network): Duration (0.000) sec 01/09/2025 02:17:07.046 7f274b976f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:__link_local__ connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:__link_local__:__link_local__, ] total_acl_rules = 0 >> 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:dci-network connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:dci-network:__default__, default-domain:default-project:dci-network:dci-network, ] total_acl_rules = 0 >> 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:default-virtual-network connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:default-virtual-network:default-virtual-network, ] total_acl_rules = 0 >> 01/09/2025 02:17:07.047 7f274b976f60 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.247 7f274fd061c8 [contrail-schema] [DEBUG]: Add uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.203) sec 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.248 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.249 7f27480ed048 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.249 7f27480ed048 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] UveVirtualNetworkConfigTrace: data = << name = default-domain:default-project:ip-fabric connected_networks = [ ] partially_connected_networks = [ ] routing_instance_list = [ default-domain:default-project:ip-fabric:ip-fabric, default-domain:default-project:ip-fabric:__default__, ] total_acl_rules = 3 >> 01/09/2025 02:17:07.249 7f27480ed048 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.257 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.258 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.263 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.264 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.264 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Start 01/09/2025 02:17:07.483 7f274fd061c8 [contrail-schema] [DEBUG]: obj.evaluate - REINIT Complete 01/09/2025 02:17:07.523 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'obj_dict': {'config_node_ip_address': '10.0.0.30', 'display_name': 'cn-jenkins-deploy-platform-juju-os-463-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'id_perms': {'created': '2025-01-09T02:17:05.211355', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:05.211355', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11441750094393440926, 'uuid_mslong': 6149003303606436619}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5555a5ed-022a-430b-9ec9-4317011cfa9e'}, 'oper': 'CREATE', 'request-id': 'req-e2f7b455-4d62-4401-bf21-e0c1804be223', 'type': 'config_node', 'uuid': '5555a5ed-022a-430b-9ec9-4317011cfa9e'} 01/09/2025 02:17:07.524 7f274b993198 [contrail-schema] [ERROR]: Error in rabbitmq drainer greenlet: 'SchemaTransformerLogger' object has no attribute 'warn' 01/09/2025 02:17:07.524 7f274b993198 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:07.525 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-01-09T02:17:06.129239', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.129239', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12220087159727175155, 'uuid_mslong': 6668487082921314776}}, 'parent_type': 'security-group', 'parent_uuid': '74ff3f86-d263-4632-8423-40c42750b5d7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5c8b39ab-b6ce-49d8-a996-7886e7d9b5f3'}, 'oper': 'CREATE', 'request-id': 'req-2e37088a-0bda-4648-acf8-ae4248e33bc3', 'type': 'access_control_list', 'uuid': '5c8b39ab-b6ce-49d8-a996-7886e7d9b5f3'} 01/09/2025 02:17:07.526 7f274b97beb8 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.526 7f274b97beb8 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:07.526 7f274b97beb8 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.539 7f274b993198 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:07.732 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.733 7f274b98bd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Down description = Connect to Idle on EvTcpConnectFail >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Connect to Idle on EvTcpConnectFail] connection down >>, ] >> 01/09/2025 02:17:07.733 7f274b98bd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Idle] 01/09/2025 02:17:07.733 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvIdleHoldTimerExpired] in state[Idle] 01/09/2025 02:17:07.738 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'ingress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'id_perms': {'created': '2025-01-09T02:17:06.129239', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.129239', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12220087159727175155, 'uuid_mslong': 6668487082921314776}}, 'parent_type': 'security-group', 'parent_uuid': '74ff3f86-d263-4632-8423-40c42750b5d7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '5c8b39ab-b6ce-49d8-a996-7886e7d9b5f3'}, 'oper': 'CREATE', 'request-id': 'req-2e37088a-0bda-4648-acf8-ae4248e33bc3', 'type': 'access_control_list', 'uuid': '5c8b39ab-b6ce-49d8-a996-7886e7d9b5f3'} 01/09/2025 02:17:07.742 7f274b993198 [contrail-schema] [ERROR]: Error in rabbitmq drainer greenlet: 'SchemaTransformerLogger' object has no attribute 'warn' 01/09/2025 02:17:07.742 7f274b993198 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:07.744 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-01-09T02:17:06.266885', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.266885', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10627243226312944828, 'uuid_mslong': 16100478291553701383}}, 'parent_type': 'security-group', 'parent_uuid': '74ff3f86-d263-4632-8423-40c42750b5d7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'df7063b3-c1f2-4e07-937b-8d68a60f2cbc'}, 'oper': 'CREATE', 'request-id': 'req-982359b5-eeb4-4f90-9e00-68f2575336fc', 'type': 'access_control_list', 'uuid': 'df7063b3-c1f2-4e07-937b-8d68a60f2cbc'} 01/09/2025 02:17:07.753 7f274b98bd68 [contrail-schema] [INFO]: Session Event: TCP Connected 01/09/2025 02:17:07.753 7f274b98bd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvIdleHoldTimerExpired] => State[Idle] -> State[Connect] 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Up description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired] connection down >>, ] >> 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [ERROR]: SANDESH: [DROP: WrongClientSMState] NodeStatusUVE: data = << name = cn-jenkins-deploy-platform-juju-os-463-1 process_status = [ << module_id = contrail-schema instance_id = 0 state = Non-Functional connection_infos = [ << type = Collector name = Collector server_addrs = [ 10.0.0.30:8086, ] status = Initializing description = Idle to Connect on EvIdleHoldTimerExpired >>, << type = Database name = RabbitMQ server_addrs = [ 10.0.0.30:5673, ] status = Down description = >>, << type = Zookeeper name = Zookeeper server_addrs = [ 10.0.0.30:2181, ] status = Up description = >>, << type = ApiServer name = ApiServer server_addrs = [ 10.0.0.30:8082, ] status = Up description = ApiServer >>, << type = Database name = Cassandra server_addrs = [ 10.0.0.30:9041, ] status = Up description = >>, ] description = Collector:Collector[Idle to Connect on EvIdleHoldTimerExpired], Database:RabbitMQ[] connection down >>, ] >> 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [INFO]: Discarding event[EvSandeshUVESend] in state[Connect] 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvTcpConnected] in state[Connect] 01/09/2025 02:17:07.754 7f274b98bd68 [contrail-schema] [DEBUG]: Send sandesh control message. uve type count # 19 01/09/2025 02:17:07.755 7f274b98bd68 [contrail-schema] [INFO]: Sandesh Client: Event[EvTcpConnected] => State[Connect] -> State[ClientInit] 01/09/2025 02:17:07.755 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/09/2025 02:17:07.755 7f274b98bd68 [contrail-schema] [INFO]: Processing event[EvSandeshUVESend] in state[ClientInit] 01/09/2025 02:17:07.755 7f274b98c390 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/09/2025 02:17:07.756 7f274b98c390 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/09/2025 02:17:07.761 7f274b985b70 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001012 01/09/2025 02:17:07.762 7f274b985b70 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/09/2025 02:17:07.762 7f274b9ac4e0 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[ClientInit] 01/09/2025 02:17:07.762 7f274b9ac4e0 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 0 01/09/2025 02:17:07.762 7f274b9ac4e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:17:07.762 7f274b9ac4e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.762 7f274b9ac4e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.762 7f274b9ac4e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.763 7f274b9ac4e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:07.763 7f274b9ac4e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/09/2025 02:17:07.763 7f274b9ac4e0 [contrail-schema] [INFO]: Sandesh Client: Event[EvSandeshCtrlMessageRecv] => State[ClientInit] -> State[Established] 01/09/2025 02:17:07.763 7f274b985d68 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/09/2025 02:17:07.766 7f274b985d68 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/09/2025 02:17:07.772 7f274b993198 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:07.779 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [], 'dynamic': None}, 'display_name': 'egress-access-control-list', 'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'id_perms': {'created': '2025-01-09T02:17:06.266885', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.266885', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10627243226312944828, 'uuid_mslong': 16100478291553701383}}, 'parent_type': 'security-group', 'parent_uuid': '74ff3f86-d263-4632-8423-40c42750b5d7', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'df7063b3-c1f2-4e07-937b-8d68a60f2cbc'}, 'oper': 'CREATE', 'request-id': 'req-982359b5-eeb4-4f90-9e00-68f2575336fc', 'type': 'access_control_list', 'uuid': 'df7063b3-c1f2-4e07-937b-8d68a60f2cbc'} 01/09/2025 02:17:07.783 7f274b993198 [contrail-schema] [ERROR]: Error in rabbitmq drainer greenlet: 'SchemaTransformerLogger' object has no attribute 'warn' 01/09/2025 02:17:07.783 7f274b993198 [contrail-schema] [WARNING]: RabbitMQ drainer connection down 01/09/2025 02:17:07.784 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-01-09T02:17:06.404194', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.404194', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11917620539937074726, 'uuid_mslong': 7887445199600242507}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': '6d75d59e-9b88-4f4b-a563-e4bd22d92e26'}, 'oper': 'CREATE', 'request-id': 'req-0577f644-7534-4cda-9526-cf2ca2192d7f', 'type': 'route_target', 'uuid': '6d75d59e-9b88-4f4b-a563-e4bd22d92e26'} 01/09/2025 02:17:07.787 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-d7948d7e-51d2-4380-93f0-e6709740b565', 'type': 'routing_instance', 'uuid': '60b82638-143e-4fb3-be4e-7797b0f25272'} 01/09/2025 02:17:07.788 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-01-09T02:17:06.552684', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.552684', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10280361145125106425, 'uuid_mslong': 11615008783037646823}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': 'a130ccf3-0000-47e7-8eab-2dfe69e8f2f9'}, 'oper': 'CREATE', 'request-id': 'req-145d7787-f8c3-4fde-a92a-c5ba73c5b58c', 'type': 'route_target', 'uuid': 'a130ccf3-0000-47e7-8eab-2dfe69e8f2f9'} 01/09/2025 02:17:07.789 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-d4735e48-7451-4fde-8a04-c9ebaad43f47', 'type': 'routing_instance', 'uuid': '7ccd7963-a4bb-4ad9-a895-896da9622a38'} 01/09/2025 02:17:07.790 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-01-09T02:17:06.691041', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.691041', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11314553950827716375, 'uuid_mslong': 6480096668882321725}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': '59eded96-5aec-413d-9d05-5edf07141f17'}, 'oper': 'CREATE', 'request-id': 'req-8f9eaeff-8cb2-4301-a97c-e5dcbe651295', 'type': 'route_target', 'uuid': '59eded96-5aec-413d-9d05-5edf07141f17'} 01/09/2025 02:17:07.795 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-174db29f-4fd1-481c-afb4-955e61da5884', 'type': 'routing_instance', 'uuid': '40239400-b7a9-427e-b4a0-56edc83d239c'} 01/09/2025 02:17:07.798 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-01-09T02:17:06.883873', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.883873', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13753062862860003159, 'uuid_mslong': 1209794129414931093}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': '10ca0d59-d721-4295-bedc-b1ce92632757'}, 'oper': 'CREATE', 'request-id': 'req-50afed25-6cd3-4b27-9596-73ef2e884ba0', 'type': 'route_target', 'uuid': '10ca0d59-d721-4295-bedc-b1ce92632757'} 01/09/2025 02:17:07.798 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-4c324084-30d9-419a-935b-97851a6da52c', 'type': 'routing_instance', 'uuid': '79725781-5dd5-4c86-8486-26ed3fabafea'} 01/09/2025 02:17:07.829 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-01-09T02:17:07.152871', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:07.152871', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11047434182329512836, 'uuid_mslong': 9682373747881823130}}, 'parent_type': 'virtual-network', 'parent_uuid': '081dc85a-9efd-4324-9714-4ab2c115217f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '865eb39f-d110-4b9a-9950-5edb65423384'}, 'oper': 'CREATE', 'request-id': 'req-9615686d-5133-45da-bae2-7ab0f1a75a7f', 'type': 'access_control_list', 'uuid': '865eb39f-d110-4b9a-9950-5edb65423384'} 01/09/2025 02:17:07.831 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-5ce323b1-b962-4575-9397-5322f064739e', 'type': 'access_control_list', 'uuid': '5c8b39ab-b6ce-49d8-a996-7886e7d9b5f3'} 01/09/2025 02:17:07.835 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-de03c5d7-4726-4e11-b1e7-6b9c92193d8f', 'type': 'access_control_list', 'uuid': 'df7063b3-c1f2-4e07-937b-8d68a60f2cbc'} 01/09/2025 02:17:07.880 7f274b993198 [contrail-schema] [WARNING]: RabbitMQ drainer connection ESTABLISHED 01/09/2025 02:17:07.890 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000000'], 'obj_dict': {'display_name': 'target:64512:8000000', 'fq_name': ['target:64512:8000000'], 'id_perms': {'created': '2025-01-09T02:17:06.404194', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.404194', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11917620539937074726, 'uuid_mslong': 7887445199600242507}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': '6d75d59e-9b88-4f4b-a563-e4bd22d92e26'}, 'oper': 'CREATE', 'request-id': 'req-0577f644-7534-4cda-9526-cf2ca2192d7f', 'type': 'route_target', 'uuid': '6d75d59e-9b88-4f4b-a563-e4bd22d92e26'} 01/09/2025 02:17:07.891 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', '__default__'], 'oper': 'UPDATE', 'request-id': 'req-d7948d7e-51d2-4380-93f0-e6709740b565', 'type': 'routing_instance', 'uuid': '60b82638-143e-4fb3-be4e-7797b0f25272'} 01/09/2025 02:17:07.893 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000001'], 'obj_dict': {'display_name': 'target:64512:8000001', 'fq_name': ['target:64512:8000001'], 'id_perms': {'created': '2025-01-09T02:17:06.552684', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.552684', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10280361145125106425, 'uuid_mslong': 11615008783037646823}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': 'a130ccf3-0000-47e7-8eab-2dfe69e8f2f9'}, 'oper': 'CREATE', 'request-id': 'req-145d7787-f8c3-4fde-a92a-c5ba73c5b58c', 'type': 'route_target', 'uuid': 'a130ccf3-0000-47e7-8eab-2dfe69e8f2f9'} 01/09/2025 02:17:07.894 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'dci-network', 'dci-network'], 'oper': 'UPDATE', 'request-id': 'req-d4735e48-7451-4fde-8a04-c9ebaad43f47', 'type': 'routing_instance', 'uuid': '7ccd7963-a4bb-4ad9-a895-896da9622a38'} 01/09/2025 02:17:07.898 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000002'], 'obj_dict': {'display_name': 'target:64512:8000002', 'fq_name': ['target:64512:8000002'], 'id_perms': {'created': '2025-01-09T02:17:06.691041', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.691041', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11314553950827716375, 'uuid_mslong': 6480096668882321725}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': '59eded96-5aec-413d-9d05-5edf07141f17'}, 'oper': 'CREATE', 'request-id': 'req-8f9eaeff-8cb2-4301-a97c-e5dcbe651295', 'type': 'route_target', 'uuid': '59eded96-5aec-413d-9d05-5edf07141f17'} 01/09/2025 02:17:07.899 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'default-virtual-network', 'default-virtual-network'], 'oper': 'UPDATE', 'request-id': 'req-174db29f-4fd1-481c-afb4-955e61da5884', 'type': 'routing_instance', 'uuid': '40239400-b7a9-427e-b4a0-56edc83d239c'} 01/09/2025 02:17:07.904 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['target:64512:8000003'], 'obj_dict': {'display_name': 'target:64512:8000003', 'fq_name': ['target:64512:8000003'], 'id_perms': {'created': '2025-01-09T02:17:06.883873', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:06.883873', 'permissions': {'group': 'cloud-admin-group', 'group_access': 7, 'other_access': 7, 'owner': 'cloud-admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13753062862860003159, 'uuid_mslong': 1209794129414931093}}, 'perms2': {'global_access': 0, 'owner': 'b2371817becf486f8218210893cf4b5e', 'owner_access': 7, 'share': []}, 'uuid': '10ca0d59-d721-4295-bedc-b1ce92632757'}, 'oper': 'CREATE', 'request-id': 'req-50afed25-6cd3-4b27-9596-73ef2e884ba0', 'type': 'route_target', 'uuid': '10ca0d59-d721-4295-bedc-b1ce92632757'} 01/09/2025 02:17:07.905 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-4c324084-30d9-419a-935b-97851a6da52c', 'type': 'routing_instance', 'uuid': '79725781-5dd5-4c86-8486-26ed3fabafea'} 01/09/2025 02:17:07.911 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'obj_dict': {'access_control_list_entries': {'acl_rule': [{'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'deny'}, 'direction': '<>', 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'default-domain:default-project:ip-fabric'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000002'}, {'action_list': {'alert': False, 'apply_service': [], 'assign_routing_instance': None, 'gateway_name': None, 'host_based_service': False, 'log': False, 'mirror_to': None, 'qos_action': None, 'service_properties': None, 'simple_action': 'pass'}, 'direction': None, 'match_condition': {'dst_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'dst_port': {'end_port': 65535, 'start_port': 0}, 'ethertype': None, 'protocol': 'any', 'src_address': {'network_policy': None, 'security_group': None, 'subnet': None, 'subnet_list': [], 'virtual_network': 'any'}, 'src_port': {'end_port': 65535, 'start_port': 0}}, 'rule_uuid': '00000000-0000-0000-0000-100000000001'}], 'dynamic': False}, 'display_name': 'ip-fabric', 'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'id_perms': {'created': '2025-01-09T02:17:07.152871', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:07.152871', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11047434182329512836, 'uuid_mslong': 9682373747881823130}}, 'parent_type': 'virtual-network', 'parent_uuid': '081dc85a-9efd-4324-9714-4ab2c115217f', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '865eb39f-d110-4b9a-9950-5edb65423384'}, 'oper': 'CREATE', 'request-id': 'req-9615686d-5133-45da-bae2-7ab0f1a75a7f', 'type': 'access_control_list', 'uuid': '865eb39f-d110-4b9a-9950-5edb65423384'} 01/09/2025 02:17:07.912 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'ingress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-5ce323b1-b962-4575-9397-5322f064739e', 'type': 'access_control_list', 'uuid': '5c8b39ab-b6ce-49d8-a996-7886e7d9b5f3'} 01/09/2025 02:17:07.914 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', '__no_rule__', 'egress-access-control-list'], 'oper': 'UPDATE', 'request-id': 'req-de03c5d7-4726-4e11-b1e7-6b9c92193d8f', 'type': 'access_control_list', 'uuid': 'df7063b3-c1f2-4e07-937b-8d68a60f2cbc'} 01/09/2025 02:17:11.133 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-900efd8e-b53a-4f84-bd81-cd935f14a61e', 'type': 'global_vrouter_config', 'uuid': '4a40060c-f8a7-4fc8-871a-34ecadf59cde'} 01/09/2025 02:17:12.124 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements', 'operand2': {'json_value': '1'}, 'operation': 'size=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-elements-inconsistency', 'fq_name': ['default-global-system-config', 'system-defined-conf-elements-inconsistency'], 'id_perms': {'created': '2025-01-09T02:17:12.114543', 'creator': None, 'description': 'ContrailConfig has a list of ' 'elements - it should be a dict. ' 'Controllers have inconsistency in ' 'their data.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.114543', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10144161239169123680, 'uuid_mslong': 313124488317848523}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '04587110-28a9-4bcb-8cc7-4ce6a4f64560', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e27cea6a-806f-4288-aa08-5708b4ee9e85', 'type': 'alarm', 'uuid': '04587110-28a9-4bcb-8cc7-4ce6a4f64560'} 01/09/2025 02:17:12.179 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_ip_address', 'operand2': {'uve_attribute': 'VrouterAgent.control_ip'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-compute', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-compute'], 'id_perms': {'created': '2025-01-09T02:17:12.170618', 'creator': None, 'description': 'Compute Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.170618', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11145790477383148361, 'uuid_mslong': 8940988019897880403}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '7c14c53b-9309-4f53-9aad-cd62e15aa349', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e7a75405-7b72-4dd2-b3de-e2cdbe32b36f', 'type': 'alarm', 'uuid': '7c14c53b-9309-4f53-9aad-cd62e15aa349'} 01/09/2025 02:17:12.266 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.bgp_router_parameters.address', 'operand2': {'uve_attribute': 'BgpRouterState.bgp_router_ip_list'}, 'operation': 'not ' 'in'}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-address-mismatch-control', 'fq_name': ['default-global-system-config', 'system-defined-address-mismatch-control'], 'id_perms': {'created': '2025-01-09T02:17:12.254846', 'creator': None, 'description': 'Control Node IP Address mismatch.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.254846', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13826826152815730930, 'uuid_mslong': 16287791566759347631}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e209dc22-304b-45af-bfe2-c120d9a9a0f2', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-e76944fa-39d3-4ede-90d5-3047ff64f9f1', 'type': 'alarm', 'uuid': 'e209dc22-304b-45af-bfe2-c120d9a9a0f2'} 01/09/2025 02:17:12.342 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_bgp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_bgp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-bgp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-bgp-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:12.329894', 'creator': None, 'description': 'BGP peer mismatch. Not enough BGP ' 'peers are up.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.329894', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11350981090377236271, 'uuid_mslong': 1661040740873358980}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '170d33c0-d535-4e84-9d86-c929601c7f2f', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-666da6f4-f445-4f0b-8aef-680d9a857583', 'type': 'alarm', 'uuid': '170d33c0-d535-4e84-9d86-c929601c7f2f'} 01/09/2025 02:17:12.417 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-conf-incorrect', 'fq_name': ['default-global-system-config', 'system-defined-conf-incorrect'], 'id_perms': {'created': '2025-01-09T02:17:12.410257', 'creator': None, 'description': 'ContrailConfig missing or ' 'incorrect. Configuration pushed to ' 'Ifmap as ContrailConfig is ' 'missing/incorrect.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.410257', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9505299973895413062, 'uuid_mslong': 627925215918902660}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '08b6d6a8-305b-4d84-83e9-9bf70b90dd46', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-1c5d9a01-5789-4f11-a076-4f455c13e99e', 'type': 'alarm', 'uuid': '08b6d6a8-305b-4d84-83e9-9bf70b90dd46'} 01/09/2025 02:17:12.491 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '[70, ' '90]'}, 'operation': 'range', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-disk-usage-high', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-high'], 'id_perms': {'created': '2025-01-09T02:17:12.481113', 'creator': None, 'description': 'Disk usage crosses high threshold ' 'limit.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.481113', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12031027536832510908, 'uuid_mslong': 2505912867882682713}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '22c6ca79-f83a-4959-a6f6-cbcd37d83bbc', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-0c8df78f-abf2-4611-8358-e07626627c51', 'type': 'alarm', 'uuid': '22c6ca79-f83a-4959-a6f6-cbcd37d83bbc'} 01/09/2025 02:17:12.569 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.disk_usage_info.*.percentage_partition_space_used', 'operand2': {'json_value': '90'}, 'operation': '>', 'variables': ['NodeStatus.disk_usage_info.__key']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-disk-usage-critical', 'fq_name': ['default-global-system-config', 'system-defined-disk-usage-critical'], 'id_perms': {'created': '2025-01-09T02:17:12.559732', 'creator': None, 'description': 'Disk usage crosses critical ' 'threshold limit.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.559732', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12910193470155528731, 'uuid_mslong': 7334522386921113838}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '65c97540-3d95-48ee-b32a-388f5a301a1b', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-ecf39fde-cc25-41e5-9e29-a19f26e0992d', 'type': 'alarm', 'uuid': '65c97540-3d95-48ee-b32a-388f5a301a1b'} 01/09/2025 02:17:12.646 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-node-status', 'fq_name': ['default-global-system-config', 'system-defined-node-status'], 'id_perms': {'created': '2025-01-09T02:17:12.637888', 'creator': None, 'description': 'Node Failure. NodeStatus UVE not ' 'present.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.637888', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10987962032868071135, 'uuid_mslong': 16529525856212109930}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e564ac30-6528-4a6a-987d-15408e9496df', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-19fd6799-1dfa-4dbd-a8d9-4c480f60d700', 'type': 'alarm', 'uuid': 'e564ac30-6528-4a6a-987d-15408e9496df'} 01/09/2025 02:17:12.724 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.build_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-partial-sysinfo', 'fq_name': ['default-global-system-config', 'system-defined-partial-sysinfo'], 'id_perms': {'created': '2025-01-09T02:17:12.712252', 'creator': None, 'description': 'System Info Incomplete.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.712252', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9290584443843798029, 'uuid_mslong': 7528790807798891143}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '687ba359-b714-4287-80ee-c953fb14640d', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-d7b16edf-0d37-4628-b616-9db5cfcd852b', 'type': 'alarm', 'uuid': '687ba359-b714-4287-80ee-c953fb14640d'} 01/09/2025 02:17:12.802 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_status', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_status.state', 'operand2': {'json_value': '"Functional"'}, 'operation': '!=', 'variables': ['NodeStatus.process_status.module_id', 'NodeStatus.process_status.instance_id']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-process-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:12.789664', 'creator': None, 'description': 'Process(es) reporting as ' 'non-functional.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.789664', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13468799295902584398, 'uuid_mslong': 2654152975275149313}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '24d57211-96d2-4801-baea-c9994f4e0e4e', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-7d7848d6-d57f-4c41-837d-d0974d4e0bb7', 'type': 'alarm', 'uuid': '24d57211-96d2-4801-baea-c9994f4e0e4e'} 01/09/2025 02:17:12.870 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.process_info', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'NodeStatus.process_info.process_state', 'operand2': {'json_value': '"PROCESS_STATE_RUNNING"'}, 'operation': '!=', 'variables': ['NodeStatus.process_info.process_name']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-process-status', 'fq_name': ['default-global-system-config', 'system-defined-process-status'], 'id_perms': {'created': '2025-01-09T02:17:12.861196', 'creator': None, 'description': 'Process Failure.', 'enable': True, 'last_modified': '2025-01-09T02:17:12.861196', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11966246762247803243, 'uuid_mslong': 10630822936088235493}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '93884522-c79d-4de5-a610-a607c672d16b', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-5488cc4b-4a31-484f-b3a3-e1fd44333940', 'type': 'alarm', 'uuid': '93884522-c79d-4de5-a610-a607c672d16b'} 01/09/2025 02:17:12.947 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.connected_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:12.933802', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tor agent does not exist we look ' 'for non-empty value for ' 'connected_agent_list', 'enable': True, 'last_modified': '2025-01-09T02:17:12.933802', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10426646850355048131, 'uuid_mslong': 2060276888057105997}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '1c9792e9-f397-4e4d-90b2-e41151dbaec3', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-619807ee-9f7d-495f-8584-96013676097d', 'type': 'alarm', 'uuid': '1c9792e9-f397-4e4d-90b2-e41151dbaec3'} 01/09/2025 02:17:13.055 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '1'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '!='}]}, {'and_list': [{'operand1': 'ContrailConfig.elements.virtual_router_refs', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'ProuterData.tsn_agent_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}, {'operand1': 'ProuterData.gateway_mode', 'operand2': {'json_value': '"SERVER"'}, 'operation': '=='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-prouter-tsn-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-prouter-tsn-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:13.003949', 'creator': None, 'description': 'Prouter connectivity to controlling ' 'tsn agent does not exist we look ' 'for non-empty value for ' 'tsn_agent_list', 'enable': True, 'last_modified': '2025-01-09T02:17:13.003949', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13819648541707433070, 'uuid_mslong': 11473313970520211666}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '9f396644-9962-40d2-bfc9-41210937746e', 'uve_keys': {'uve_key': ['prouter']}}, 'oper': 'CREATE', 'request-id': 'req-9540a96e-a1f3-4874-856b-0e3d5aa4548c', 'type': 'alarm', 'uuid': '9f396644-9962-40d2-bfc9-41210937746e'} 01/09/2025 02:17:13.124 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'StorageCluster.info_stats.status', 'operand2': {'json_value': '0'}, 'operation': '!=', 'variables': ['StorageCluster.info_stats.health_summary']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-storage-cluster-state', 'fq_name': ['default-global-system-config', 'system-defined-storage-cluster-state'], 'id_perms': {'created': '2025-01-09T02:17:13.115609', 'creator': None, 'description': 'Storage Cluster warning/errors.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.115609', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12426507443137976189, 'uuid_mslong': 16607624161691125557}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'e67a222f-20cb-4735-ac73-d2ae5afc977d', 'uve_keys': {'uve_key': ['storage-cluster']}}, 'oper': 'CREATE', 'request-id': 'req-e6962bba-f645-4d58-b78d-b4c8a6268170', 'type': 'alarm', 'uuid': 'e67a222f-20cb-4735-ac73-d2ae5afc977d'} 01/09/2025 02:17:13.191 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.down_interface_count', 'operand2': {'json_value': '1'}, 'operation': '>=', 'variables': ['VrouterAgent.error_intf_list', 'VrouterAgent.no_config_intf_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-interface', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-interface'], 'id_perms': {'created': '2025-01-09T02:17:13.185291', 'creator': None, 'description': 'Vrouter interface(s) down.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.185291', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13413013484027878463, 'uuid_mslong': 14133036282239535946}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'c422a19e-6098-4b4a-ba24-98b2d3019c3f', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-e20bea53-86a1-4f34-98ce-bbc12e7bdb9f', 'type': 'alarm', 'uuid': 'c422a19e-6098-4b4a-ba24-98b2d3019c3f'} 01/09/2025 02:17:13.267 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'json_value': 'null'}, 'operation': '=='}]}, {'and_list': [{'operand1': 'BgpRouterState.num_up_xmpp_peer', 'operand2': {'uve_attribute': 'BgpRouterState.num_xmpp_peer'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-connectivity', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-connectivity'], 'id_perms': {'created': '2025-01-09T02:17:13.257441', 'creator': None, 'description': 'XMPP peer mismatch.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.257441', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12560468853806998600, 'uuid_mslong': 2990091319901114299}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '297ef036-98af-4fbb-ae4f-bfdfd3862448', 'uve_keys': {'uve_key': ['control-node']}}, 'oper': 'CREATE', 'request-id': 'req-db41e7eb-2586-40e9-b7b4-93c6d580deaa', 'type': 'alarm', 'uuid': '297ef036-98af-4fbb-ae4f-bfdfd3862448'} 01/09/2025 02:17:13.340 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'XmppPeerInfoData.close_reason', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'XmppPeerInfoData.state_info.state', 'operand2': {'json_value': '"Established"'}, 'operation': '!='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-xmpp-close-reason', 'fq_name': ['default-global-system-config', 'system-defined-xmpp-close-reason'], 'id_perms': {'created': '2025-01-09T02:17:13.325662', 'creator': None, 'description': 'XMPP connection closed towards ' 'peer, ' 'alarm has close reason', 'enable': True, 'last_modified': '2025-01-09T02:17:13.325662', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10743058213502208515, 'uuid_mslong': 2950341665036911144}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '28f1b81c-de8f-4228-9517-0286a9244a03', 'uve_keys': {'uve_key': ['xmpp-peer']}}, 'oper': 'CREATE', 'request-id': 'req-f6001a46-5e3e-4ccb-9b55-a4d633c409b0', 'type': 'alarm', 'uuid': '28f1b81c-de8f-4228-9517-0286a9244a03'} 01/09/2025 02:17:13.405 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': 'null'}, 'operation': '!='}, {'operand1': 'NodeStatus.all_core_file_list', 'operand2': {'json_value': '0'}, 'operation': 'size!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-core-files', 'fq_name': ['default-global-system-config', 'system-defined-core-files'], 'id_perms': {'created': '2025-01-09T02:17:13.396725', 'creator': None, 'description': 'A core file has been generated on ' 'the node.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.396725', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13028234261701715960, 'uuid_mslong': 4585284688803217494}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3fa23421-6e27-4056-b4cd-9608d34de7f8', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-997f7227-54b1-48d8-9195-5ae011a0b5d1', 'type': 'alarm', 'uuid': '3fa23421-6e27-4056-b4cd-9608d34de7f8'} 01/09/2025 02:17:13.488 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'CassandraStatusData.cassandra_compaction_task.pending_compaction_tasks', 'operand2': {'json_value': '300'}, 'operation': '>='}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-pending-cassandra-compaction-tasks', 'fq_name': ['default-global-system-config', 'system-defined-pending-cassandra-compaction-tasks'], 'id_perms': {'created': '2025-01-09T02:17:13.480947', 'creator': None, 'description': 'Pending compaction tasks in ' 'cassandra crossed the configured ' 'threshold.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.480947', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 13336613675459094834, 'uuid_mslong': 7583069290198222620}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '693c7957-b570-471c-b915-2b7a385b2932', 'uve_keys': {'uve_key': ['database-nodeconfig-database-node']}}, 'oper': 'CREATE', 'request-id': 'req-0666c849-e99f-40a6-947f-2203ea802bf5', 'type': 'alarm', 'uuid': '693c7957-b570-471c-b915-2b7a385b2932'} 01/09/2025 02:17:13.564 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'NodeStatus.running_package_version', 'operand2': {'uve_attribute': 'NodeStatus.installed_package_version'}, 'operation': '!='}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-package-version-mismatch', 'fq_name': ['default-global-system-config', 'system-defined-package-version-mismatch'], 'id_perms': {'created': '2025-01-09T02:17:13.554135', 'creator': None, 'description': 'There is a mismatch between ' 'installed and running package ' 'version.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.554135', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 9933151292459632140, 'uuid_mslong': 15577677332137330408}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd82f06ff-dfb3-46e8-89d9-a478ef44c60c', 'uve_keys': {'uve_key': ['analytics-node', 'analytics-alarm-node', 'analytics-snmp-node', 'config-node', 'control-node', 'database-node', 'config-database-node', 'vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-080ce1e7-af21-4945-bad2-951642009dd8', 'type': 'alarm', 'uuid': 'd82f06ff-dfb3-46e8-89d9-a478ef44c60c'} 01/09/2025 02:17:13.655 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 1, 'display_name': 'system-defined-vrouter-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-limit-exceeded'], 'id_perms': {'created': '2025-01-09T02:17:13.639288', 'creator': None, 'description': 'Agent resource usage exceeded ' 'configured watermark for resource.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.639288', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11353580258893046320, 'uuid_mslong': 10354905309498197287}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '8fb40384-2f72-4527-9d90-051774352230', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-27a57ec3-f253-460c-82fc-b370b33782ef', 'type': 'alarm', 'uuid': '8fb40384-2f72-4527-9d90-051774352230'} 01/09/2025 02:17:13.730 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.res_table_limit', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_limit_exceeded_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-table-limit-exceeded', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-table-limit-exceeded'], 'id_perms': {'created': '2025-01-09T02:17:13.720673', 'creator': None, 'description': 'Agent resource usage exceeded table ' 'size for resource in vrouter.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.720673', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 11598472773119035830, 'uuid_mslong': 4542401281182746556}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '3f09d9e6-082d-47bc-a0f6-0d892accc9b6', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-32bbeac1-d4b1-4d65-b48c-2198a024e647', 'type': 'alarm', 'uuid': '3f09d9e6-082d-47bc-a0f6-0d892accc9b6'} 01/09/2025 02:17:13.818 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'obj_dict': {'alarm_rules': {'or_list': [{'and_list': [{'operand1': 'VrouterAgent.l3mh_phy_interface_down', 'operand2': {'json_value': 'true'}, 'operation': '==', 'variables': ['VrouterAgent.vr_l3mh_intf_list']}]}]}, 'alarm_severity': 0, 'display_name': 'system-defined-vrouter-l3mh-physical-interface-link-down', 'fq_name': ['default-global-system-config', 'system-defined-vrouter-l3mh-physical-interface-link-down'], 'id_perms': {'created': '2025-01-09T02:17:13.805488', 'creator': None, 'description': 'On l3 multihomed compute one or ' 'more physical interfaces are ' 'Inactive.', 'enable': True, 'last_modified': '2025-01-09T02:17:13.805488', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10328796806102084008, 'uuid_mslong': 15304874303921015249}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'd465d617-3937-49d1-8f57-41f888e769a8', 'uve_keys': {'uve_key': ['vrouter']}}, 'oper': 'CREATE', 'request-id': 'req-36539a1d-b976-4bfd-bae9-1855dd24d5f0', 'type': 'alarm', 'uuid': 'd465d617-3937-49d1-8f57-41f888e769a8'} 01/09/2025 02:17:14.195 7f274b490d68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:17:14.712 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-12792160-d7cb-441e-b043-cd3bf0e3d580', 'type': 'global_vrouter_config', 'uuid': '4a40060c-f8a7-4fc8-871a-34ecadf59cde'} 01/09/2025 02:17:14.713 7f274b985b70 [contrail-schema] [DEBUG]: Extracted sandesh length: 0000001438 01/09/2025 02:17:14.713 7f274b985b70 [contrail-schema] [DEBUG]: Received sandesh control message [SandeshCtrlServerToClient] 01/09/2025 02:17:14.715 7f274e035e10 [contrail-schema] [INFO]: Processing event[EvSandeshCtrlMessageRecv] in state[Established] 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: Number of uve types in sandesh control message is 3 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectVNTable:UveVirtualNetworkConfigTrace] map 01/09/2025 02:17:14.720 7f274e035e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectGeneratorInfo:SandeshModuleClientTrace] map 01/09/2025 02:17:14.721 7f275161c978 [contrail-schema] [INFO]: Sandesh Send Level [INVALID] -> [SYS_DEBUG] 01/09/2025 02:17:14.755 7f275161c978 [contrail-schema] [INFO]: Sandesh Send Level [SYS_DEBUG] -> [INVALID] 01/09/2025 02:17:15.621 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'default-global-vrouter-config'], 'oper': 'UPDATE', 'request-id': 'req-34c9e9ec-2e28-4600-941c-72e8a5651862', 'type': 'global_vrouter_config', 'uuid': '4a40060c-f8a7-4fc8-871a-34ecadf59cde'} 01/09/2025 02:17:16.548 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-5e853201-87a0-42c3-8a03-c147016cc4c4', 'type': 'global_system_config', 'uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2'} 01/09/2025 02:17:20.214 7f274b427e10 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:17:39.630 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config'], 'oper': 'UPDATE', 'request-id': 'req-e1b2d9f9-b30d-4be7-aa09-a428c30bbeaa', 'type': 'global_system_config', 'uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2'} 01/09/2025 02:17:39.751 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'obj_dict': {'display_name': 'cn-jenkins-deploy-platform-juju-os-463-1', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'id_perms': {'created': '2025-01-09T02:17:39.745131', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:39.745131', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 10561244828635684022, 'uuid_mslong': 532377784496046314}}, 'parent_type': 'global-system-config', 'parent_uuid': 'bfac16b2-426c-4066-9eda-cbc055bcddf2', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6', 'virtual_router_dpdk_enabled': False, 'virtual_router_ip_address': '10.0.0.30'}, 'oper': 'CREATE', 'request-id': 'req-c89ab482-fb77-468a-911d-1bf93def51b0', 'type': 'virtual_router', 'uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6'} 01/09/2025 02:17:40.072 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'obj_dict': {'display_name': 'vhost0', 'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'id_perms': {'created': '2025-01-09T02:17:40.064458', 'creator': None, 'description': None, 'enable': True, 'last_modified': '2025-01-09T02:17:40.064458', 'permissions': {'group': 'member', 'group_access': 7, 'other_access': 7, 'owner': 'admin', 'owner_access': 7}, 'user_visible': True, 'uuid': {'uuid_lslong': 12942856144445515433, 'uuid_mslong': 16911707484456371175}}, 'parent_type': 'virtual-router', 'parent_uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6', 'perms2': {'global_access': 0, 'owner': 'cloud-admin', 'owner_access': 7, 'share': []}, 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9', 'virtual_machine_interface_disable_policy': True, 'virtual_machine_interface_mac_addresses': {'mac_address': ['02:ea:b2:74:5a:e4']}, 'virtual_network_refs': [{'to': ['default-domain', 'default-project', 'ip-fabric'], 'uuid': '081dc85a-9efd-4324-9714-4ab2c115217f'}]}, 'oper': 'CREATE', 'request-id': 'req-e0fbc162-669c-4507-8f01-b660d34347bd', 'type': 'virtual_machine_interface', 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9'} 01/09/2025 02:17:40.080 7f274b993198 [contrail-schema] [DEBUG]: Process VPG collecting information of vlan_id and physical interface 01/09/2025 02:17:40.081 7f274b993198 [contrail-schema] [DEBUG]: Collected hostname: None 01/09/2025 02:17:40.081 7f274b993198 [contrail-schema] [DEBUG]: Process VPG collected vlan_id and physical interface and fabric 01/09/2025 02:17:40.121 7f274b993198 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.040) sec 01/09/2025 02:17:40.122 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e0fbc162-669c-4507-8f01-b660d34347bd', 'type': 'virtual_machine_interface', 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9'} 01/09/2025 02:17:40.127 7f274b993198 [contrail-schema] [DEBUG]: Process VPG collecting information of vlan_id and physical interface 01/09/2025 02:17:40.127 7f274b993198 [contrail-schema] [DEBUG]: Collected hostname: None 01/09/2025 02:17:40.127 7f274b993198 [contrail-schema] [DEBUG]: Process VPG collected vlan_id and physical interface and fabric 01/09/2025 02:17:40.128 7f274b993198 [contrail-schema] [WARNING]: Virtual-Network Evaluate Complete: VN Name (default-domain:default-project:ip-fabric): Duration (0.000) sec 01/09/2025 02:17:40.128 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', 'ip-fabric'], 'oper': 'UPDATE', 'request-id': 'req-a1c1fecf-a50c-47bc-b843-748c8ec2c300', 'type': 'access_control_list', 'uuid': '865eb39f-d110-4b9a-9950-5edb65423384'} 01/09/2025 02:17:48.859 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-domain', 'default-project', 'ip-fabric', '__default__', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'oper': 'UPDATE', 'request-id': 'req-8b92ed53-67d6-45c0-a444-f449a560a8f7', 'type': 'bgp_router', 'uuid': '52085add-001a-44c7-8476-58cfd53a283e'} 01/09/2025 02:17:54.386 7f274b4ae6d8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:18:11.011 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1'], 'oper': 'UPDATE', 'request-id': 'req-4742e85a-0b3b-458d-a72e-f89165168207', 'type': 'virtual_router', 'uuid': '076362c6-3b32-40ea-9291-14373cc2dcb6'} 01/09/2025 02:18:11.288 7f274b993198 [contrail-schema] [DEBUG]: Notification Message: {'fq_name': ['default-global-system-config', 'cn-jenkins-deploy-platform-juju-os-463-1', 'vhost0'], 'oper': 'UPDATE', 'request-id': 'req-e00b6778-4ef8-48e6-bc67-543b5551b121', 'type': 'virtual_machine_interface', 'uuid': 'eab2745a-e456-43e7-b39e-4316d4a826a9'} 01/09/2025 02:18:15.784 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:18:26.282 7f274b9768d0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:18:31.962 7f274b9768d0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:18:52.075 7f274b9768d0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:19:00.324 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:19:06.116 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:19:11.235 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:19:15.018 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:21:50.599 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:21:55.302 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:22:00.886 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:22:05.739 7f274b96ff60 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:25:58.107 7f274dfd34e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:26:02.809 7f274dfd34e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:26:08.538 7f274dfd34e0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:27:50.055 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:30:17.640 7f274c441588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:30:22.456 7f274c441588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:30:28.615 7f274b422630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:31:52.349 7f274b422630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:35:56.125 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:36:05.608 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:36:10.904 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:36:17.099 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:41:43.406 7f274b4228d0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:41:48.437 7f274b4228d0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:41:53.181 7f274b4228d0 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:41:58.803 7f274b422438 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:46:55.012 7f274ea7f630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:47:45.522 7f274bcfcd68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:47:52.395 7f274bcfcd68 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:47:58.424 7f274b414eb8 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:51:36.332 7f274c441780 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:52:59.639 7f274ea7f630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:53:04.623 7f274ea7f630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:53:10.363 7f274ea7f630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:55:45.497 7f274b48e390 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:58:10.351 7f274b422630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:58:15.434 7f274b422630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 02:58:21.180 7f274b422630 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map 01/09/2025 03:00:35.612 7f274c441588 [contrail-schema] [DEBUG]: send sync_uve in the [ObjectConfigNode:NodeStatusUVE] map