2026-03-30 03:33:25.114 [info] <0.8.0> Log file opened with Lager 2026-03-30 03:33:28.008 [info] <0.8.0> Feature flags: list of feature flags found: 2026-03-30 03:33:28.008 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:33:28.033 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-03-30 03:33:28.034 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:33:28.046 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2026-03-30 03:33:28.046 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-30 03:33:28.047 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-30 03:33:28.057 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2026-03-30 03:33:28.068 [info] <0.248.0> Enabling free disk space monitoring 2026-03-30 03:33:28.068 [info] <0.248.0> Disk free limit set to 50MB 2026-03-30 03:33:28.073 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2026-03-30 03:33:28.073 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2026-03-30 03:33:28.073 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2026-03-30 03:33:28.073 [info] <0.252.0> FHC read buffering: OFF 2026-03-30 03:33:28.073 [info] <0.252.0> FHC write buffering: ON 2026-03-30 03:33:28.074 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2026-03-30 03:33:28.074 [info] <0.241.0> Will use 4 processes for default worker pool 2026-03-30 03:33:28.074 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-03-30 03:33:28.074 [info] <0.240.0> Running boot step database defined by app rabbit 2026-03-30 03:33:28.075 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-03-30 03:33:28.075 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-03-30 03:33:28.075 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:33:28.075 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2026-03-30 03:33:28.075 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2026-03-30 03:33:28.075 [info] <0.240.0> Will wait for 15454 milliseconds before proceeding with registration... 2026-03-30 03:33:43.531 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5563-1, contrail@cn-jenkins-deploy-platform-ansible-os-5563-2, contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 2026-03-30 03:33:43.531 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5563-1, contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 2026-03-30 03:33:43.540 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:43.544 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:43.544 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2026-03-30 03:33:44.046 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:44.047 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:44.047 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2026-03-30 03:33:44.549 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:44.550 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:44.550 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2026-03-30 03:33:45.051 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:45.052 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:45.052 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2026-03-30 03:33:45.554 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:45.554 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:45.555 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2026-03-30 03:33:46.056 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:46.056 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:46.057 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2026-03-30 03:33:46.558 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:46.559 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:46.559 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2026-03-30 03:33:47.061 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:47.061 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:47.062 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2026-03-30 03:33:47.562 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:47.563 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:47.563 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2026-03-30 03:33:48.065 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-1: {error,tables_not_present} 2026-03-30 03:33:48.066 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-5563-3: {error,tables_not_present} 2026-03-30 03:33:48.066 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2026-03-30 03:33:48.567 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-5563-1,contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 (as in Erlang distribution). Starting as a blank standalone node... 2026-03-30 03:33:48.569 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:33:48.730 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:33:48.730 [info] <0.240.0> Successfully synced tables from a peer 2026-03-30 03:33:48.758 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:33:48.759 [info] <0.240.0> Successfully synced tables from a peer 2026-03-30 03:33:48.806 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:33:48.807 [info] <0.240.0> Successfully synced tables from a peer 2026-03-30 03:33:48.807 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-30 03:33:48.807 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-30 03:33:48.808 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-30 03:33:48.809 [info] <0.477.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-03-30 03:33:48.810 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2026-03-30 03:33:48.813 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-30 03:33:48.814 [info] <0.481.0> Starting rabbit_node_monitor 2026-03-30 03:33:48.814 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2026-03-30 03:33:48.815 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-30 03:33:48.815 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2026-03-30 03:33:48.815 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2026-03-30 03:33:48.836 [info] <0.240.0> message_store upgrades: 1 to apply 2026-03-30 03:33:48.836 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-03-30 03:33:48.837 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-03-30 03:33:48.837 [info] <0.240.0> message_store upgrades: Removing the old message store data 2026-03-30 03:33:48.837 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2026-03-30 03:33:48.861 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-03-30 03:33:48.862 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-30 03:33:48.862 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-30 03:33:48.862 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-30 03:33:48.862 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2026-03-30 03:33:48.863 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2026-03-30 03:33:48.863 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-30 03:33:48.863 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-30 03:33:48.863 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-03-30 03:33:48.863 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-03-30 03:33:48.863 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-03-30 03:33:48.863 [info] <0.240.0> Management plugin: using rates mode 'basic' 2026-03-30 03:33:48.864 [info] <0.240.0> Running boot step recovery defined by app rabbit 2026-03-30 03:33:48.865 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2026-03-30 03:33:48.866 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-03-30 03:33:48.866 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2026-03-30 03:33:48.866 [info] <0.240.0> Importing users... 2026-03-30 03:33:48.866 [info] <0.240.0> Creating user 'guest' 2026-03-30 03:33:48.874 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2026-03-30 03:33:48.881 [info] <0.240.0> Importing vhosts... 2026-03-30 03:33:48.882 [info] <0.240.0> Adding vhost '/' 2026-03-30 03:33:48.919 [info] <0.577.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-30 03:33:48.924 [info] <0.577.0> Starting message stores for vhost '/' 2026-03-30 03:33:48.924 [info] <0.583.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:33:48.926 [info] <0.577.0> Started message store of type transient for vhost '/' 2026-03-30 03:33:48.926 [info] <0.586.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:33:48.926 [warning] <0.586.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-03-30 03:33:48.927 [info] <0.577.0> Started message store of type persistent for vhost '/' 2026-03-30 03:33:49.234 [info] <0.481.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:33:49.257 [info] <0.240.0> Importing user permissions... 2026-03-30 03:33:49.257 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-03-30 03:33:49.262 [info] <0.240.0> Importing topic permissions... 2026-03-30 03:33:49.262 [info] <0.240.0> Importing parameters... 2026-03-30 03:33:49.262 [info] <0.240.0> Importing global parameters... 2026-03-30 03:33:49.262 [info] <0.240.0> Importing policies... 2026-03-30 03:33:49.265 [info] <0.240.0> Importing queues... 2026-03-30 03:33:49.265 [info] <0.240.0> Importing exchanges... 2026-03-30 03:33:49.265 [info] <0.240.0> Importing bindings... 2026-03-30 03:33:49.265 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2026-03-30 03:33:49.266 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-30 03:33:49.266 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-30 03:33:49.266 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2026-03-30 03:33:49.266 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2026-03-30 03:33:49.279 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:33:49.287 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:33:49.287 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2026-03-30 03:33:49.287 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2026-03-30 03:33:49.287 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2026-03-30 03:33:49.287 [info] <0.240.0> Running boot step networking defined by app rabbit 2026-03-30 03:33:49.288 [info] <0.481.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:33:49.289 [info] <0.726.0> started TCP listener on [::]:5673 2026-03-30 03:33:49.289 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2026-03-30 03:33:49.289 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2026-03-30 03:33:49.289 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2026-03-30 03:33:49.289 [info] <0.728.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-03-30 03:33:49.327 [info] <0.779.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-03-30 03:33:49.328 [info] <0.885.0> Statistics database started. 2026-03-30 03:33:49.328 [info] <0.884.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-03-30 03:33:49.328 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-03-30 03:33:49.423 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-03-30 03:33:52.530 [info] <0.481.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' up 2026-03-30 03:33:53.494 [info] <0.481.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' down 2026-03-30 03:33:53.507 [info] <0.481.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 listeners: the node is already back 2026-03-30 03:33:54.527 [info] <0.481.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' down: connection_closed 2026-03-30 03:33:56.663 [info] <0.1074.0> RabbitMQ is asked to stop... 2026-03-30 03:33:56.722 [info] <0.1074.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-03-30 03:33:56.722 [info] <0.1074.0> Stopping application 'rabbitmq_management' 2026-03-30 03:33:56.724 [warning] <0.734.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-03-30 03:33:56.726 [info] <0.1074.0> Stopping application 'amqp_client' 2026-03-30 03:33:56.726 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-03-30 03:33:56.727 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-03-30 03:33:56.727 [info] <0.1074.0> Stopping application 'rabbitmq_web_dispatch' 2026-03-30 03:33:56.729 [info] <0.1074.0> Stopping application 'cowboy' 2026-03-30 03:33:56.729 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-03-30 03:33:56.730 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-03-30 03:33:56.730 [info] <0.1074.0> Stopping application 'cowlib' 2026-03-30 03:33:56.730 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-03-30 03:33:56.730 [info] <0.1074.0> Stopping application 'rabbitmq_management_agent' 2026-03-30 03:33:56.732 [info] <0.1074.0> Stopping application 'rabbit' 2026-03-30 03:33:56.732 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-03-30 03:33:56.732 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:33:56.732 [info] <0.726.0> stopped TCP listener on [::]:5673 2026-03-30 03:33:56.732 [info] <0.524.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' because the vhost is stopping 2026-03-30 03:33:56.732 [info] <0.586.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-03-30 03:33:56.738 [info] <0.586.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-03-30 03:33:56.738 [info] <0.583.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-03-30 03:33:56.742 [info] <0.583.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-03-30 03:33:56.744 [info] <0.1074.0> Stopping application 'mnesia' 2026-03-30 03:33:56.744 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-03-30 03:33:56.746 [info] <0.1074.0> Stopping application 'rabbit_common' 2026-03-30 03:33:56.746 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:33:56.746 [info] <0.1074.0> Stopping application 'sysmon_handler' 2026-03-30 03:33:56.746 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-03-30 03:33:56.748 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-03-30 03:33:56.748 [info] <0.1074.0> Stopping application 'os_mon' 2026-03-30 03:33:56.749 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-03-30 03:33:56.749 [info] <0.1074.0> Successfully stopped RabbitMQ and its dependencies 2026-03-30 03:33:56.749 [info] <0.1074.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-03-30 03:34:01.966 [info] <0.8.0> Log file opened with Lager 2026-03-30 03:34:03.423 [info] <0.8.0> Feature flags: list of feature flags found: 2026-03-30 03:34:03.423 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:34:03.503 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:34:03.561 [info] <0.304.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-03-30 03:34:03.561 [info] <0.304.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:34:03.574 [info] <0.304.0> Running boot step pre_boot defined by app rabbit 2026-03-30 03:34:03.574 [info] <0.304.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-30 03:34:03.575 [info] <0.304.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-30 03:34:03.581 [info] <0.332.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2026-03-30 03:34:03.588 [info] <0.349.0> Enabling free disk space monitoring 2026-03-30 03:34:03.588 [info] <0.349.0> Disk free limit set to 50MB 2026-03-30 03:34:03.592 [info] <0.304.0> Running boot step code_server_cache defined by app rabbit 2026-03-30 03:34:03.592 [info] <0.304.0> Running boot step file_handle_cache defined by app rabbit 2026-03-30 03:34:03.592 [info] <0.374.0> Limiting to approx 65436 file handles (58890 sockets) 2026-03-30 03:34:03.592 [info] <0.375.0> FHC read buffering: OFF 2026-03-30 03:34:03.592 [info] <0.375.0> FHC write buffering: ON 2026-03-30 03:34:03.593 [info] <0.304.0> Running boot step worker_pool defined by app rabbit 2026-03-30 03:34:03.593 [info] <0.305.0> Will use 4 processes for default worker pool 2026-03-30 03:34:03.593 [info] <0.305.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-03-30 03:34:03.593 [info] <0.304.0> Running boot step database defined by app rabbit 2026-03-30 03:34:03.634 [info] <0.304.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:34:03.637 [info] <0.304.0> Successfully synced tables from a peer 2026-03-30 03:34:03.638 [info] <0.304.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:34:03.638 [info] <0.304.0> Successfully synced tables from a peer 2026-03-30 03:34:03.665 [info] <0.304.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:34:03.665 [info] <0.304.0> Successfully synced tables from a peer 2026-03-30 03:34:03.665 [info] <0.304.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step database_sync defined by app rabbit 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step feature_flags defined by app rabbit 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step external_infrastructure defined by app rabbit 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step rabbit_registry defined by app rabbit 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-30 03:34:03.665 [info] <0.304.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_event defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-30 03:34:03.666 [info] <0.304.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step kernel_ready defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-30 03:34:03.667 [info] <0.304.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-30 03:34:03.668 [info] <0.413.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-03-30 03:34:03.668 [info] <0.304.0> Running boot step guid_generator defined by app rabbit 2026-03-30 03:34:03.673 [info] <0.304.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-30 03:34:03.674 [info] <0.417.0> Starting rabbit_node_monitor 2026-03-30 03:34:03.674 [info] <0.304.0> Running boot step delegate_sup defined by app rabbit 2026-03-30 03:34:03.675 [info] <0.304.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-30 03:34:03.675 [info] <0.304.0> Running boot step core_initialized defined by app rabbit 2026-03-30 03:34:03.675 [info] <0.304.0> Running boot step upgrade_queues defined by app rabbit 2026-03-30 03:34:03.696 [info] <0.304.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-03-30 03:34:03.696 [info] <0.304.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-30 03:34:03.696 [info] <0.304.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-30 03:34:03.697 [info] <0.304.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-30 03:34:03.697 [info] <0.304.0> Running boot step rabbit_policies defined by app rabbit 2026-03-30 03:34:03.697 [info] <0.304.0> Running boot step rabbit_policy defined by app rabbit 2026-03-30 03:34:03.697 [info] <0.304.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-30 03:34:03.698 [info] <0.304.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-30 03:34:03.698 [info] <0.304.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-03-30 03:34:03.698 [info] <0.304.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-03-30 03:34:03.698 [warning] <0.304.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-03-30 03:34:03.698 [info] <0.304.0> Management plugin: using rates mode 'basic' 2026-03-30 03:34:03.709 [info] <0.304.0> Running boot step recovery defined by app rabbit 2026-03-30 03:34:03.710 [info] <0.454.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-30 03:34:03.715 [info] <0.454.0> Starting message stores for vhost '/' 2026-03-30 03:34:03.715 [info] <0.458.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:34:03.717 [info] <0.454.0> Started message store of type transient for vhost '/' 2026-03-30 03:34:03.717 [info] <0.461.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:34:03.719 [info] <0.454.0> Started message store of type persistent for vhost '/' 2026-03-30 03:34:03.720 [info] <0.304.0> Running boot step load_definitions defined by app rabbitmq_management 2026-03-30 03:34:03.720 [info] <0.304.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-03-30 03:34:03.720 [info] <0.304.0> Asked to import definitions. Acting user: rmq-internal 2026-03-30 03:34:03.720 [info] <0.304.0> Importing users... 2026-03-30 03:34:03.725 [info] <0.304.0> Setting user tags for user 'guest' to [administrator] 2026-03-30 03:34:03.731 [info] <0.304.0> Importing vhosts... 2026-03-30 03:34:03.731 [info] <0.304.0> Importing user permissions... 2026-03-30 03:34:03.731 [info] <0.304.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-03-30 03:34:03.743 [info] <0.304.0> Importing topic permissions... 2026-03-30 03:34:03.743 [info] <0.304.0> Importing parameters... 2026-03-30 03:34:03.743 [info] <0.304.0> Importing global parameters... 2026-03-30 03:34:03.743 [info] <0.304.0> Importing policies... 2026-03-30 03:34:03.747 [info] <0.304.0> Importing queues... 2026-03-30 03:34:03.747 [info] <0.304.0> Importing exchanges... 2026-03-30 03:34:03.747 [info] <0.304.0> Importing bindings... 2026-03-30 03:34:03.747 [info] <0.304.0> Running boot step empty_db_check defined by app rabbit 2026-03-30 03:34:03.747 [info] <0.304.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-30 03:34:03.748 [info] <0.304.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-30 03:34:03.748 [info] <0.304.0> Running boot step background_gc defined by app rabbit 2026-03-30 03:34:03.748 [info] <0.304.0> Running boot step connection_tracking defined by app rabbit 2026-03-30 03:34:03.749 [info] <0.304.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:34:03.750 [info] <0.304.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:34:03.750 [info] <0.304.0> Running boot step routing_ready defined by app rabbit 2026-03-30 03:34:03.750 [info] <0.304.0> Running boot step pre_flight defined by app rabbit 2026-03-30 03:34:03.750 [info] <0.304.0> Running boot step notify_cluster defined by app rabbit 2026-03-30 03:34:03.750 [info] <0.304.0> Running boot step networking defined by app rabbit 2026-03-30 03:34:03.751 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' up 2026-03-30 03:34:03.752 [info] <0.502.0> started TCP listener on [::]:5673 2026-03-30 03:34:03.752 [info] <0.304.0> Running boot step cluster_name defined by app rabbit 2026-03-30 03:34:03.752 [info] <0.304.0> Running boot step direct_client defined by app rabbit 2026-03-30 03:34:03.753 [info] <0.304.0> Running boot step os_signal_handler defined by app rabbit 2026-03-30 03:34:03.753 [info] <0.504.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-03-30 03:34:03.763 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:34:03.800 [info] <0.556.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-03-30 03:34:03.801 [info] <0.662.0> Statistics database started. 2026-03-30 03:34:03.801 [info] <0.661.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-03-30 03:34:03.801 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-03-30 03:34:03.920 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2026-03-30 03:43:21.671 [info] <0.1305.0> RabbitMQ is asked to stop... 2026-03-30 03:43:21.751 [info] <0.1305.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-03-30 03:43:21.751 [info] <0.1305.0> Stopping application 'rabbitmq_management' 2026-03-30 03:43:21.752 [warning] <0.510.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-03-30 03:43:21.754 [info] <0.1305.0> Stopping application 'amqp_client' 2026-03-30 03:43:21.754 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-03-30 03:43:21.755 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-03-30 03:43:21.756 [info] <0.1305.0> Stopping application 'rabbitmq_web_dispatch' 2026-03-30 03:43:21.758 [info] <0.1305.0> Stopping application 'cowboy' 2026-03-30 03:43:21.758 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-03-30 03:43:21.759 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-03-30 03:43:21.759 [info] <0.1305.0> Stopping application 'cowlib' 2026-03-30 03:43:21.759 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-03-30 03:43:21.759 [info] <0.1305.0> Stopping application 'rabbitmq_management_agent' 2026-03-30 03:43:21.761 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-03-30 03:43:21.761 [info] <0.1305.0> Stopping application 'rabbit' 2026-03-30 03:43:21.761 [info] <0.304.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:43:21.761 [info] <0.502.0> stopped TCP listener on [::]:5673 2026-03-30 03:43:21.762 [info] <0.442.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' because the vhost is stopping 2026-03-30 03:43:21.763 [info] <0.461.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-03-30 03:43:21.770 [info] <0.461.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-03-30 03:43:21.770 [info] <0.458.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-03-30 03:43:21.773 [info] <0.458.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-03-30 03:43:21.780 [info] <0.1305.0> Stopping application 'mnesia' 2026-03-30 03:43:21.780 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-03-30 03:43:21.786 [info] <0.1305.0> Stopping application 'rabbit_common' 2026-03-30 03:43:21.786 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:43:21.786 [info] <0.1305.0> Stopping application 'sysmon_handler' 2026-03-30 03:43:21.786 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-03-30 03:43:21.787 [info] <0.1305.0> Stopping application 'os_mon' 2026-03-30 03:43:21.787 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-03-30 03:43:21.789 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-03-30 03:43:21.789 [info] <0.1305.0> Successfully stopped RabbitMQ and its dependencies 2026-03-30 03:43:21.789 [info] <0.1305.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2026-03-30 03:43:46.719 [info] <0.8.0> Log file opened with Lager 2026-03-30 03:43:53.434 [info] <0.8.0> Feature flags: list of feature flags found: 2026-03-30 03:43:53.434 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:43:53.979 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:43:54.200 [info] <0.308.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-03-30 03:43:54.208 [info] <0.308.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:43:54.315 [info] <0.308.0> Running boot step pre_boot defined by app rabbit 2026-03-30 03:43:54.315 [info] <0.308.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-30 03:43:54.315 [info] <0.308.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-30 03:43:54.418 [info] <0.322.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2026-03-30 03:43:54.482 [info] <0.333.0> Enabling free disk space monitoring 2026-03-30 03:43:54.482 [info] <0.333.0> Disk free limit set to 50MB 2026-03-30 03:43:54.509 [info] <0.308.0> Running boot step code_server_cache defined by app rabbit 2026-03-30 03:43:54.514 [info] <0.308.0> Running boot step file_handle_cache defined by app rabbit 2026-03-30 03:43:54.517 [info] <0.348.0> FHC read buffering: OFF 2026-03-30 03:43:54.517 [info] <0.347.0> Limiting to approx 65436 file handles (58890 sockets) 2026-03-30 03:43:54.518 [info] <0.348.0> FHC write buffering: ON 2026-03-30 03:43:54.559 [info] <0.308.0> Running boot step worker_pool defined by app rabbit 2026-03-30 03:43:54.559 [info] <0.311.0> Will use 4 processes for default worker pool 2026-03-30 03:43:54.559 [info] <0.311.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-03-30 03:43:54.559 [info] <0.308.0> Running boot step database defined by app rabbit 2026-03-30 03:43:54.642 [info] <0.308.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:43:54.798 [info] <0.308.0> Successfully synced tables from a peer 2026-03-30 03:43:54.805 [info] <0.308.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:43:54.806 [info] <0.308.0> Successfully synced tables from a peer 2026-03-30 03:43:55.094 [info] <0.308.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:43:55.107 [info] <0.308.0> Successfully synced tables from a peer 2026-03-30 03:43:55.107 [info] <0.308.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:43:55.108 [info] <0.308.0> Running boot step database_sync defined by app rabbit 2026-03-30 03:43:55.109 [info] <0.308.0> Running boot step feature_flags defined by app rabbit 2026-03-30 03:43:55.115 [info] <0.308.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-30 03:43:55.115 [info] <0.308.0> Running boot step external_infrastructure defined by app rabbit 2026-03-30 03:43:55.116 [info] <0.308.0> Running boot step rabbit_registry defined by app rabbit 2026-03-30 03:43:55.116 [info] <0.308.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_event defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-30 03:43:55.117 [info] <0.308.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step kernel_ready defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-30 03:43:55.118 [info] <0.308.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-30 03:43:55.126 [info] <0.413.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-03-30 03:43:55.126 [info] <0.308.0> Running boot step guid_generator defined by app rabbit 2026-03-30 03:43:55.169 [info] <0.308.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-30 03:43:55.176 [info] <0.419.0> Starting rabbit_node_monitor 2026-03-30 03:43:55.177 [info] <0.308.0> Running boot step delegate_sup defined by app rabbit 2026-03-30 03:43:55.177 [info] <0.308.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-30 03:43:55.177 [info] <0.308.0> Running boot step core_initialized defined by app rabbit 2026-03-30 03:43:55.177 [info] <0.308.0> Running boot step upgrade_queues defined by app rabbit 2026-03-30 03:43:55.361 [info] <0.308.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-03-30 03:43:55.361 [info] <0.308.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-30 03:43:55.361 [info] <0.308.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-30 03:43:55.361 [info] <0.308.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-30 03:43:55.361 [info] <0.308.0> Running boot step rabbit_policies defined by app rabbit 2026-03-30 03:43:55.362 [info] <0.308.0> Running boot step rabbit_policy defined by app rabbit 2026-03-30 03:43:55.362 [info] <0.308.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-30 03:43:55.362 [info] <0.308.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-30 03:43:55.362 [info] <0.308.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-03-30 03:43:55.362 [info] <0.308.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-03-30 03:43:55.362 [warning] <0.308.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-03-30 03:43:55.362 [info] <0.308.0> Management plugin: using rates mode 'basic' 2026-03-30 03:43:55.376 [info] <0.308.0> Running boot step recovery defined by app rabbit 2026-03-30 03:43:55.380 [info] <0.459.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-30 03:43:55.419 [info] <0.459.0> Starting message stores for vhost '/' 2026-03-30 03:43:55.419 [info] <0.463.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:43:55.463 [info] <0.459.0> Started message store of type transient for vhost '/' 2026-03-30 03:43:55.463 [info] <0.467.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:43:55.489 [info] <0.459.0> Started message store of type persistent for vhost '/' 2026-03-30 03:43:55.491 [info] <0.459.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.486.0> 2026-03-30 03:43:55.491 [info] <0.459.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.490.0> 2026-03-30 03:43:55.491 [info] <0.459.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.494.0> 2026-03-30 03:43:55.492 [info] <0.459.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.498.0> 2026-03-30 03:43:55.492 [info] <0.459.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.502.0> 2026-03-30 03:43:55.492 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.506.0> 2026-03-30 03:43:55.492 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.510.0> 2026-03-30 03:43:55.493 [info] <0.459.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.514.0> 2026-03-30 03:43:55.493 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.518.0> 2026-03-30 03:43:55.493 [info] <0.459.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.522.0> 2026-03-30 03:43:55.493 [info] <0.459.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.526.0> 2026-03-30 03:43:55.494 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.530.0> 2026-03-30 03:43:55.494 [info] <0.459.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.534.0> 2026-03-30 03:43:55.494 [info] <0.459.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.538.0> 2026-03-30 03:43:55.499 [info] <0.459.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.542.0> 2026-03-30 03:43:55.499 [info] <0.459.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.546.0> 2026-03-30 03:43:55.499 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.550.0> 2026-03-30 03:43:55.499 [info] <0.459.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.554.0> 2026-03-30 03:43:55.500 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.558.0> 2026-03-30 03:43:55.500 [info] <0.459.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.562.0> 2026-03-30 03:43:55.500 [info] <0.459.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.566.0> 2026-03-30 03:43:55.501 [info] <0.459.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.570.0> 2026-03-30 03:43:55.501 [info] <0.459.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.576.0> 2026-03-30 03:43:55.502 [info] <0.459.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.580.0> 2026-03-30 03:43:55.502 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.584.0> 2026-03-30 03:43:55.502 [info] <0.459.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.588.0> 2026-03-30 03:43:55.524 [info] <0.308.0> Running boot step load_definitions defined by app rabbitmq_management 2026-03-30 03:43:55.534 [info] <0.308.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-03-30 03:43:55.540 [info] <0.308.0> Asked to import definitions. Acting user: rmq-internal 2026-03-30 03:43:55.541 [info] <0.308.0> Importing users... 2026-03-30 03:43:55.596 [info] <0.308.0> Setting user tags for user 'guest' to [administrator] 2026-03-30 03:43:55.725 [info] <0.308.0> Importing vhosts... 2026-03-30 03:43:55.725 [info] <0.308.0> Importing user permissions... 2026-03-30 03:43:55.725 [info] <0.308.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-03-30 03:43:55.818 [info] <0.308.0> Importing topic permissions... 2026-03-30 03:43:55.818 [info] <0.308.0> Importing parameters... 2026-03-30 03:43:55.818 [info] <0.308.0> Importing global parameters... 2026-03-30 03:43:55.818 [info] <0.308.0> Importing policies... 2026-03-30 03:43:55.861 [info] <0.308.0> Importing queues... 2026-03-30 03:43:55.861 [info] <0.308.0> Importing exchanges... 2026-03-30 03:43:55.861 [info] <0.308.0> Importing bindings... 2026-03-30 03:43:55.861 [info] <0.308.0> Running boot step empty_db_check defined by app rabbit 2026-03-30 03:43:55.861 [info] <0.308.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-30 03:43:55.861 [info] <0.308.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-30 03:43:55.861 [info] <0.308.0> Running boot step background_gc defined by app rabbit 2026-03-30 03:43:55.862 [info] <0.308.0> Running boot step connection_tracking defined by app rabbit 2026-03-30 03:43:55.863 [info] <0.308.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:43:55.886 [info] <0.308.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:43:55.887 [info] <0.308.0> Running boot step routing_ready defined by app rabbit 2026-03-30 03:43:55.887 [info] <0.308.0> Running boot step pre_flight defined by app rabbit 2026-03-30 03:43:55.887 [info] <0.308.0> Running boot step notify_cluster defined by app rabbit 2026-03-30 03:43:55.887 [info] <0.308.0> Running boot step networking defined by app rabbit 2026-03-30 03:43:55.887 [info] <0.419.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' up 2026-03-30 03:43:55.891 [info] <0.697.0> started TCP listener on [::]:5673 2026-03-30 03:43:55.897 [info] <0.308.0> Running boot step cluster_name defined by app rabbit 2026-03-30 03:43:55.897 [info] <0.308.0> Running boot step direct_client defined by app rabbit 2026-03-30 03:43:55.897 [info] <0.308.0> Running boot step os_signal_handler defined by app rabbit 2026-03-30 03:43:55.897 [info] <0.700.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-03-30 03:43:56.240 [info] <0.779.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-03-30 03:43:56.241 [info] <0.885.0> Statistics database started. 2026-03-30 03:43:56.241 [info] <0.884.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-03-30 03:43:56.242 [notice] <0.110.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-03-30 03:43:57.847 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-03-30 03:43:58.506 [info] <0.946.0> RabbitMQ is asked to stop... 2026-03-30 03:43:58.706 [info] <0.946.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-03-30 03:43:58.706 [info] <0.946.0> Stopping application 'rabbitmq_management' 2026-03-30 03:43:58.707 [warning] <0.775.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-03-30 03:43:58.711 [info] <0.946.0> Stopping application 'amqp_client' 2026-03-30 03:43:58.711 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-03-30 03:43:58.713 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-03-30 03:43:58.713 [info] <0.946.0> Stopping application 'rabbitmq_web_dispatch' 2026-03-30 03:43:58.715 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-03-30 03:43:58.715 [info] <0.946.0> Stopping application 'cowboy' 2026-03-30 03:43:58.717 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-03-30 03:43:58.717 [info] <0.946.0> Stopping application 'cowlib' 2026-03-30 03:43:58.718 [info] <0.946.0> Stopping application 'rabbitmq_management_agent' 2026-03-30 03:43:58.717 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-03-30 03:43:58.720 [info] <0.946.0> Stopping application 'rabbit' 2026-03-30 03:43:58.720 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-03-30 03:43:58.720 [info] <0.308.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:43:58.720 [info] <0.697.0> stopped TCP listener on [::]:5673 2026-03-30 03:43:58.722 [info] <0.447.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' because the vhost is stopping 2026-03-30 03:43:58.729 [info] <0.467.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-03-30 03:43:58.774 [info] <0.467.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-03-30 03:43:58.774 [info] <0.463.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-03-30 03:43:58.809 [info] <0.463.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-03-30 03:43:58.823 [info] <0.946.0> Stopping application 'mnesia' 2026-03-30 03:43:58.823 [info] <0.43.0> Application rabbit exited with reason: stopped 2026-03-30 03:43:58.830 [info] <0.946.0> Stopping application 'rabbit_common' 2026-03-30 03:43:58.830 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:43:58.830 [info] <0.946.0> Stopping application 'sysmon_handler' 2026-03-30 03:43:58.830 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2026-03-30 03:43:58.831 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2026-03-30 03:43:58.831 [info] <0.946.0> Stopping application 'os_mon' 2026-03-30 03:43:58.833 [info] <0.43.0> Application os_mon exited with reason: stopped 2026-03-30 03:43:58.833 [info] <0.946.0> Successfully stopped RabbitMQ and its dependencies 2026-03-30 03:43:58.833 [info] <0.946.0> Halting Erlang VM with the following applications: jsx ranch ssl public_key asn1 credentials_obfuscation crypto inets tools stdout_formatter xmerl observer_cli recon lager goldrush compiler syntax_tools sasl stdlib kernel 2026-03-30 03:44:17.508 [info] <0.8.0> Log file opened with Lager 2026-03-30 03:44:25.334 [info] <0.8.0> Feature flags: list of feature flags found: 2026-03-30 03:44:25.347 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:44:25.575 [info] <0.43.0> Application mnesia exited with reason: stopped 2026-03-30 03:44:25.703 [info] <0.301.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2026-03-30 03:44:25.705 [info] <0.301.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:44:25.768 [info] <0.301.0> Running boot step pre_boot defined by app rabbit 2026-03-30 03:44:25.768 [info] <0.301.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-30 03:44:25.779 [info] <0.301.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-30 03:44:25.817 [info] <0.348.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2026-03-30 03:44:25.861 [info] <0.366.0> Enabling free disk space monitoring 2026-03-30 03:44:25.861 [info] <0.366.0> Disk free limit set to 50MB 2026-03-30 03:44:25.887 [info] <0.301.0> Running boot step code_server_cache defined by app rabbit 2026-03-30 03:44:25.887 [info] <0.301.0> Running boot step file_handle_cache defined by app rabbit 2026-03-30 03:44:25.888 [info] <0.382.0> Limiting to approx 65436 file handles (58890 sockets) 2026-03-30 03:44:25.888 [info] <0.383.0> FHC read buffering: OFF 2026-03-30 03:44:25.888 [info] <0.383.0> FHC write buffering: ON 2026-03-30 03:44:25.888 [info] <0.301.0> Running boot step worker_pool defined by app rabbit 2026-03-30 03:44:25.888 [info] <0.302.0> Will use 4 processes for default worker pool 2026-03-30 03:44:25.888 [info] <0.302.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-03-30 03:44:25.888 [info] <0.301.0> Running boot step database defined by app rabbit 2026-03-30 03:44:25.929 [info] <0.301.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:44:25.933 [info] <0.301.0> Successfully synced tables from a peer 2026-03-30 03:44:25.937 [info] <0.301.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:44:25.937 [info] <0.301.0> Successfully synced tables from a peer 2026-03-30 03:44:26.025 [info] <0.301.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:44:26.025 [info] <0.301.0> Successfully synced tables from a peer 2026-03-30 03:44:26.025 [info] <0.301.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:44:26.026 [info] <0.301.0> Running boot step database_sync defined by app rabbit 2026-03-30 03:44:26.026 [info] <0.301.0> Running boot step feature_flags defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step external_infrastructure defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_registry defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_event defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-30 03:44:26.029 [info] <0.301.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-30 03:44:26.030 [info] <0.301.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-30 03:44:26.030 [info] <0.301.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step kernel_ready defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-30 03:44:26.031 [info] <0.301.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-30 03:44:26.032 [info] <0.414.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-03-30 03:44:26.032 [info] <0.301.0> Running boot step guid_generator defined by app rabbit 2026-03-30 03:44:26.047 [info] <0.301.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-30 03:44:26.049 [info] <0.418.0> Starting rabbit_node_monitor 2026-03-30 03:44:26.049 [info] <0.301.0> Running boot step delegate_sup defined by app rabbit 2026-03-30 03:44:26.050 [info] <0.301.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-30 03:44:26.051 [info] <0.301.0> Running boot step core_initialized defined by app rabbit 2026-03-30 03:44:26.051 [info] <0.301.0> Running boot step upgrade_queues defined by app rabbit 2026-03-30 03:44:26.139 [info] <0.301.0> Running boot step rabbit_connection_tracking defined by app rabbit 2026-03-30 03:44:26.140 [info] <0.301.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-30 03:44:26.140 [info] <0.301.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-30 03:44:26.141 [info] <0.301.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-30 03:44:26.141 [info] <0.301.0> Running boot step rabbit_policies defined by app rabbit 2026-03-30 03:44:26.142 [info] <0.301.0> Running boot step rabbit_policy defined by app rabbit 2026-03-30 03:44:26.142 [info] <0.301.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-30 03:44:26.142 [info] <0.301.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-30 03:44:26.142 [info] <0.301.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-03-30 03:44:26.142 [info] <0.301.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-03-30 03:44:26.142 [warning] <0.301.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-03-30 03:44:26.142 [info] <0.301.0> Management plugin: using rates mode 'basic' 2026-03-30 03:44:26.150 [info] <0.301.0> Running boot step recovery defined by app rabbit 2026-03-30 03:44:26.151 [info] <0.455.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-30 03:44:26.161 [info] <0.455.0> Starting message stores for vhost '/' 2026-03-30 03:44:26.165 [info] <0.459.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:44:26.182 [info] <0.455.0> Started message store of type transient for vhost '/' 2026-03-30 03:44:26.183 [info] <0.462.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:44:26.184 [info] <0.455.0> Started message store of type persistent for vhost '/' 2026-03-30 03:44:26.187 [info] <0.455.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.481.0> 2026-03-30 03:44:26.190 [info] <0.455.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.485.0> 2026-03-30 03:44:26.191 [info] <0.455.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.489.0> 2026-03-30 03:44:26.191 [info] <0.455.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.493.0> 2026-03-30 03:44:26.192 [info] <0.455.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.497.0> 2026-03-30 03:44:26.192 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.501.0> 2026-03-30 03:44:26.193 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.504.0> 2026-03-30 03:44:26.193 [info] <0.455.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.509.0> 2026-03-30 03:44:26.193 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.513.0> 2026-03-30 03:44:26.194 [info] <0.455.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.517.0> 2026-03-30 03:44:26.194 [info] <0.455.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.521.0> 2026-03-30 03:44:26.194 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.525.0> 2026-03-30 03:44:26.194 [info] <0.455.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.529.0> 2026-03-30 03:44:26.195 [info] <0.455.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.533.0> 2026-03-30 03:44:26.196 [info] <0.455.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.538.0> 2026-03-30 03:44:26.196 [info] <0.455.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.542.0> 2026-03-30 03:44:26.201 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.548.0> 2026-03-30 03:44:26.201 [info] <0.455.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.552.0> 2026-03-30 03:44:26.201 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.556.0> 2026-03-30 03:44:26.201 [info] <0.455.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.560.0> 2026-03-30 03:44:26.214 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.576.0> 2026-03-30 03:44:26.216 [info] <0.455.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.581.0> 2026-03-30 03:44:26.217 [info] <0.455.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.585.0> 2026-03-30 03:44:26.217 [info] <0.455.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.589.0> 2026-03-30 03:44:26.217 [info] <0.455.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.593.0> 2026-03-30 03:44:26.217 [info] <0.455.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.597.0> 2026-03-30 03:44:26.218 [info] <0.455.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.601.0> 2026-03-30 03:44:26.218 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.605.0> 2026-03-30 03:44:26.218 [info] <0.455.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.609.0> 2026-03-30 03:44:26.218 [info] <0.455.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.613.0> 2026-03-30 03:44:26.218 [info] <0.455.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.617.0> 2026-03-30 03:44:26.218 [info] <0.455.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.621.0> 2026-03-30 03:44:26.228 [info] <0.301.0> Running boot step load_definitions defined by app rabbitmq_management 2026-03-30 03:44:26.228 [info] <0.301.0> Applying definitions from /etc/rabbitmq/definitions.json 2026-03-30 03:44:26.228 [info] <0.301.0> Asked to import definitions. Acting user: rmq-internal 2026-03-30 03:44:26.229 [info] <0.301.0> Importing users... 2026-03-30 03:44:26.260 [info] <0.301.0> Setting user tags for user 'guest' to [administrator] 2026-03-30 03:44:26.326 [info] <0.301.0> Importing vhosts... 2026-03-30 03:44:26.327 [info] <0.301.0> Importing user permissions... 2026-03-30 03:44:26.327 [info] <0.301.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2026-03-30 03:44:26.373 [info] <0.301.0> Importing topic permissions... 2026-03-30 03:44:26.373 [info] <0.301.0> Importing parameters... 2026-03-30 03:44:26.373 [info] <0.301.0> Importing global parameters... 2026-03-30 03:44:26.373 [info] <0.301.0> Importing policies... 2026-03-30 03:44:26.397 [info] <0.301.0> Importing queues... 2026-03-30 03:44:26.397 [info] <0.301.0> Importing exchanges... 2026-03-30 03:44:26.397 [info] <0.301.0> Importing bindings... 2026-03-30 03:44:26.399 [info] <0.301.0> Running boot step empty_db_check defined by app rabbit 2026-03-30 03:44:26.400 [info] <0.301.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-30 03:44:26.400 [info] <0.301.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-30 03:44:26.400 [info] <0.301.0> Running boot step background_gc defined by app rabbit 2026-03-30 03:44:26.400 [info] <0.301.0> Running boot step connection_tracking defined by app rabbit 2026-03-30 03:44:26.404 [info] <0.301.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:44:26.408 [info] <0.301.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:44:26.409 [info] <0.301.0> Running boot step routing_ready defined by app rabbit 2026-03-30 03:44:26.409 [info] <0.301.0> Running boot step pre_flight defined by app rabbit 2026-03-30 03:44:26.409 [info] <0.301.0> Running boot step notify_cluster defined by app rabbit 2026-03-30 03:44:26.409 [info] <0.301.0> Running boot step networking defined by app rabbit 2026-03-30 03:44:26.411 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' up 2026-03-30 03:44:26.414 [info] <0.736.0> started TCP listener on [::]:5673 2026-03-30 03:44:26.416 [info] <0.301.0> Running boot step cluster_name defined by app rabbit 2026-03-30 03:44:26.417 [info] <0.301.0> Running boot step direct_client defined by app rabbit 2026-03-30 03:44:26.417 [info] <0.301.0> Running boot step os_signal_handler defined by app rabbit 2026-03-30 03:44:26.417 [info] <0.738.0> Swapping OS signal event handler (erl_signal_server) for our own 2026-03-30 03:44:26.615 [info] <0.802.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-03-30 03:44:26.615 [info] <0.931.0> Statistics database started. 2026-03-30 03:44:26.615 [info] <0.930.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-03-30 03:44:26.621 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2026-03-30 03:44:27.440 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2026-03-30 03:44:48.295 [info] <0.418.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:44:49.540 [info] <0.418.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:51:09.615 [info] <0.1731.0> accepting AMQP connection <0.1731.0> (10.0.0.241:59242 -> 10.0.0.241:5673) 2026-03-30 03:51:09.616 [info] <0.1734.0> accepting AMQP connection <0.1734.0> (10.0.0.141:57030 -> 10.0.0.241:5673) 2026-03-30 03:51:09.617 [info] <0.1737.0> accepting AMQP connection <0.1737.0> (10.0.0.249:46038 -> 10.0.0.241:5673) 2026-03-30 03:51:09.618 [info] <0.1741.0> accepting AMQP connection <0.1741.0> (10.0.0.249:46044 -> 10.0.0.241:5673) 2026-03-30 03:51:09.618 [info] <0.1731.0> connection <0.1731.0> (10.0.0.241:59242 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.619 [info] <0.1737.0> connection <0.1737.0> (10.0.0.249:46038 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.620 [info] <0.1734.0> connection <0.1734.0> (10.0.0.141:57030 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.621 [info] <0.1741.0> connection <0.1741.0> (10.0.0.249:46044 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.622 [info] <0.1758.0> accepting AMQP connection <0.1758.0> (10.0.0.249:46046 -> 10.0.0.241:5673) 2026-03-30 03:51:09.627 [info] <0.1770.0> accepting AMQP connection <0.1770.0> (10.0.0.141:57038 -> 10.0.0.241:5673) 2026-03-30 03:51:09.627 [info] <0.1773.0> accepting AMQP connection <0.1773.0> (10.0.0.249:46058 -> 10.0.0.241:5673) 2026-03-30 03:51:09.627 [info] <0.1776.0> accepting AMQP connection <0.1776.0> (10.0.0.141:57044 -> 10.0.0.241:5673) 2026-03-30 03:51:09.630 [info] <0.1782.0> accepting AMQP connection <0.1782.0> (10.0.0.241:59254 -> 10.0.0.241:5673) 2026-03-30 03:51:09.630 [info] <0.1785.0> accepting AMQP connection <0.1785.0> (10.0.0.249:46062 -> 10.0.0.241:5673) 2026-03-30 03:51:09.630 [info] <0.1788.0> accepting AMQP connection <0.1788.0> (10.0.0.241:59264 -> 10.0.0.241:5673) 2026-03-30 03:51:09.630 [info] <0.1791.0> accepting AMQP connection <0.1791.0> (10.0.0.141:57052 -> 10.0.0.241:5673) 2026-03-30 03:51:09.637 [info] <0.1779.0> accepting AMQP connection <0.1779.0> (10.0.0.141:57046 -> 10.0.0.241:5673) 2026-03-30 03:51:09.639 [info] <0.1776.0> connection <0.1776.0> (10.0.0.141:57044 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.639 [info] <0.1770.0> connection <0.1770.0> (10.0.0.141:57038 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.640 [info] <0.1801.0> accepting AMQP connection <0.1801.0> (10.0.0.241:59278 -> 10.0.0.241:5673) 2026-03-30 03:51:09.640 [info] <0.1804.0> accepting AMQP connection <0.1804.0> (10.0.0.241:59276 -> 10.0.0.241:5673) 2026-03-30 03:51:09.640 [info] <0.1791.0> connection <0.1791.0> (10.0.0.141:57052 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.640 [info] <0.1809.0> accepting AMQP connection <0.1809.0> (10.0.0.141:57068 -> 10.0.0.241:5673) 2026-03-30 03:51:09.640 [info] <0.1785.0> connection <0.1785.0> (10.0.0.249:46062 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.641 [info] <0.1812.0> accepting AMQP connection <0.1812.0> (10.0.0.241:59280 -> 10.0.0.241:5673) 2026-03-30 03:51:09.641 [info] <0.1782.0> connection <0.1782.0> (10.0.0.241:59254 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.642 [info] <0.1819.0> accepting AMQP connection <0.1819.0> (10.0.0.241:59290 -> 10.0.0.241:5673) 2026-03-30 03:51:09.642 [info] <0.1836.0> accepting AMQP connection <0.1836.0> (10.0.0.241:59300 -> 10.0.0.241:5673) 2026-03-30 03:51:09.643 [info] <0.1840.0> accepting AMQP connection <0.1840.0> (10.0.0.141:57080 -> 10.0.0.241:5673) 2026-03-30 03:51:09.644 [info] <0.1843.0> accepting AMQP connection <0.1843.0> (10.0.0.249:46064 -> 10.0.0.241:5673) 2026-03-30 03:51:09.644 [info] <0.1788.0> connection <0.1788.0> (10.0.0.241:59264 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.648 [info] <0.1819.0> connection <0.1819.0> (10.0.0.241:59290 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.648 [info] <0.1836.0> connection <0.1836.0> (10.0.0.241:59300 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.648 [info] <0.1840.0> connection <0.1840.0> (10.0.0.141:57080 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.648 [info] <0.1863.0> accepting AMQP connection <0.1863.0> (10.0.0.241:59314 -> 10.0.0.241:5673) 2026-03-30 03:51:09.652 [info] <0.1884.0> accepting AMQP connection <0.1884.0> (10.0.0.249:46076 -> 10.0.0.241:5673) 2026-03-30 03:51:09.655 [info] <0.1779.0> connection <0.1779.0> (10.0.0.141:57046 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.655 [info] <0.1773.0> connection <0.1773.0> (10.0.0.249:46058 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.655 [info] <0.1758.0> connection <0.1758.0> (10.0.0.249:46046 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.656 [info] <0.1804.0> connection <0.1804.0> (10.0.0.241:59276 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.656 [info] <0.1863.0> connection <0.1863.0> (10.0.0.241:59314 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.656 [info] <0.1812.0> connection <0.1812.0> (10.0.0.241:59280 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.656 [info] <0.1809.0> connection <0.1809.0> (10.0.0.141:57068 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.656 [info] <0.1801.0> connection <0.1801.0> (10.0.0.241:59278 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.657 [info] <0.1843.0> connection <0.1843.0> (10.0.0.249:46064 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.661 [info] <0.1884.0> connection <0.1884.0> (10.0.0.249:46076 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.669 [info] <0.1956.0> accepting AMQP connection <0.1956.0> (10.0.0.241:59316 -> 10.0.0.241:5673) 2026-03-30 03:51:09.681 [info] <0.1956.0> connection <0.1956.0> (10.0.0.241:59316 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:09.796 [info] <0.1977.0> accepting AMQP connection <0.1977.0> (10.0.0.141:57088 -> 10.0.0.241:5673) 2026-03-30 03:51:09.801 [info] <0.1977.0> connection <0.1977.0> (10.0.0.141:57088 -> 10.0.0.241:5673): user 'guest' authenticated and granted access to vhost '/' 2026-03-30 03:51:10.202 [warning] lager_file_backend dropped 77 messages in the last second that exceeded the limit of 50 messages/sec 2026-03-30 03:52:42.537 [info] <0.2562.0> RabbitMQ is asked to stop... 2026-03-30 03:52:42.691 [info] <0.2562.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2026-03-30 03:52:42.691 [info] <0.2562.0> Stopping application 'rabbitmq_management' 2026-03-30 03:52:42.695 [warning] <0.798.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2026-03-30 03:52:42.696 [info] <0.2562.0> Stopping application 'amqp_client' 2026-03-30 03:52:42.696 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2026-03-30 03:52:42.698 [info] <0.2562.0> Stopping application 'rabbitmq_web_dispatch' 2026-03-30 03:52:42.698 [info] <0.43.0> Application amqp_client exited with reason: stopped 2026-03-30 03:52:42.700 [info] <0.2562.0> Stopping application 'cowboy' 2026-03-30 03:52:42.700 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-03-30 03:52:42.701 [info] <0.2562.0> Stopping application 'cowlib' 2026-03-30 03:52:42.701 [info] <0.2562.0> Stopping application 'rabbitmq_management_agent' 2026-03-30 03:52:42.701 [info] <0.43.0> Application cowboy exited with reason: stopped 2026-03-30 03:52:42.701 [info] <0.43.0> Application cowlib exited with reason: stopped 2026-03-30 03:52:42.704 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2026-03-30 03:52:42.704 [info] <0.2562.0> Stopping application 'rabbit' 2026-03-30 03:52:42.704 [info] <0.301.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:52:42.705 [info] <0.736.0> stopped TCP listener on [::]:5673 2026-03-30 03:52:42.705 [error] <0.1836.0> Error on AMQP connection <0.1836.0> (10.0.0.241:59300 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1863.0> Error on AMQP connection <0.1863.0> (10.0.0.241:59314 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1992.0> Error on AMQP connection <0.1992.0> (10.0.0.249:46082 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1884.0> Error on AMQP connection <0.1884.0> (10.0.0.249:46076 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1995.0> Error on AMQP connection <0.1995.0> (10.0.0.241:59338 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1779.0> Error on AMQP connection <0.1779.0> (10.0.0.141:57046 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1734.0> Error on AMQP connection <0.1734.0> (10.0.0.141:57030 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1840.0> Error on AMQP connection <0.1840.0> (10.0.0.141:57080 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1776.0> Error on AMQP connection <0.1776.0> (10.0.0.141:57044 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1956.0> Error on AMQP connection <0.1956.0> (10.0.0.241:59316 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1801.0> Error on AMQP connection <0.1801.0> (10.0.0.241:59278 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1737.0> Error on AMQP connection <0.1737.0> (10.0.0.249:46038 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1773.0> Error on AMQP connection <0.1773.0> (10.0.0.249:46058 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.706 [error] <0.1741.0> Error on AMQP connection <0.1741.0> (10.0.0.249:46044 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1843.0> Error on AMQP connection <0.1843.0> (10.0.0.249:46064 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1819.0> Error on AMQP connection <0.1819.0> (10.0.0.241:59290 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1731.0> Error on AMQP connection <0.1731.0> (10.0.0.241:59242 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1809.0> Error on AMQP connection <0.1809.0> (10.0.0.141:57068 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1804.0> Error on AMQP connection <0.1804.0> (10.0.0.241:59276 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1770.0> Error on AMQP connection <0.1770.0> (10.0.0.141:57038 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1998.0> Error on AMQP connection <0.1998.0> (10.0.0.241:59332 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1791.0> Error on AMQP connection <0.1791.0> (10.0.0.141:57052 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1782.0> Error on AMQP connection <0.1782.0> (10.0.0.241:59254 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1758.0> Error on AMQP connection <0.1758.0> (10.0.0.249:46046 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1977.0> Error on AMQP connection <0.1977.0> (10.0.0.141:57088 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1812.0> Error on AMQP connection <0.1812.0> (10.0.0.241:59280 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1788.0> Error on AMQP connection <0.1788.0> (10.0.0.241:59264 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.707 [error] <0.1785.0> Error on AMQP connection <0.1785.0> (10.0.0.249:46062 -> 10.0.0.241:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2026-03-30 03:52:42.719 [error] <0.1830.0> Supervisor {<0.1830.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-03-30 03:52:42.719 [error] <0.1807.0> Supervisor {<0.1807.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-03-30 03:52:42.722 [error] <0.1748.0> Supervisor {<0.1748.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-03-30 03:52:42.723 [error] <0.1894.0> Supervisor {<0.1894.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2026-03-30 03:53:14.830709+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE 2026-03-30 03:53:15.295497+00:00 [info] <0.222.0> ra: starting system quorum_queues 2026-03-30 03:53:15.295614+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:53:15.373205+00:00 [info] <0.261.0> ra system 'quorum_queues' running pre init for 0 registered servers 2026-03-30 03:53:15.393186+00:00 [info] <0.262.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered 2026-03-30 03:53:15.407821+00:00 [notice] <0.267.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables 2026-03-30 03:53:15.423213+00:00 [info] <0.222.0> ra: starting system coordination 2026-03-30 03:53:15.423336+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:53:15.424220+00:00 [info] <0.274.0> ra system 'coordination' running pre init for 0 registered servers 2026-03-30 03:53:15.424844+00:00 [info] <0.275.0> ra: meta data store initialised for system coordination. 0 record(s) recovered 2026-03-30 03:53:15.425019+00:00 [notice] <0.280.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables 2026-03-30 03:53:15.431578+00:00 [info] <0.222.0> 2026-03-30 03:53:15.431578+00:00 [info] <0.222.0> Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit] 2026-03-30 03:53:15.431578+00:00 [info] <0.222.0> Copyright (c) 2007-2022 VMware, Inc. or its affiliates. 2026-03-30 03:53:15.431578+00:00 [info] <0.222.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> home dir : /var/lib/rabbitmq 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> config file(s) : /etc/rabbitmq/rabbitmq.config 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> : /etc/rabbitmq/conf.d/10-defaults.conf 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> cookie hash : esZsDxSN6VGbi9JkMSxNZA== 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2_upgrade.log 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> : 2026-03-30 03:53:15.432811+00:00 [info] <0.222.0> database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:53:15.656991+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:15.657064+00:00 [info] <0.222.0> Feature flags: [ ] classic_mirrored_queue_version 2026-03-30 03:53:15.657088+00:00 [info] <0.222.0> Feature flags: [ ] drop_unroutable_metric 2026-03-30 03:53:15.657117+00:00 [info] <0.222.0> Feature flags: [ ] empty_basic_get_metric 2026-03-30 03:53:15.657166+00:00 [info] <0.222.0> Feature flags: [ ] implicit_default_bindings 2026-03-30 03:53:15.657195+00:00 [info] <0.222.0> Feature flags: [ ] maintenance_mode_status 2026-03-30 03:53:15.657212+00:00 [info] <0.222.0> Feature flags: [ ] quorum_queue 2026-03-30 03:53:15.657303+00:00 [info] <0.222.0> Feature flags: [ ] stream_queue 2026-03-30 03:53:15.657322+00:00 [info] <0.222.0> Feature flags: [ ] user_limits 2026-03-30 03:53:15.657337+00:00 [info] <0.222.0> Feature flags: [ ] virtual_host_metadata 2026-03-30 03:53:15.657354+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:17.669944+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit 2026-03-30 03:53:17.670067+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit 2026-03-30 03:53:17.670463+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit 2026-03-30 03:53:17.670597+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-30 03:53:17.671266+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-30 03:53:17.675667+00:00 [info] <0.298.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2026-03-30 03:53:17.680905+00:00 [info] <0.300.0> Enabling free disk space monitoring 2026-03-30 03:53:17.680968+00:00 [info] <0.300.0> Disk free limit set to 50MB 2026-03-30 03:53:17.684756+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit 2026-03-30 03:53:17.684903+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit 2026-03-30 03:53:17.685142+00:00 [info] <0.305.0> Limiting to approx 927 file handles (832 sockets) 2026-03-30 03:53:17.685287+00:00 [info] <0.306.0> FHC read buffering: OFF 2026-03-30 03:53:17.685331+00:00 [info] <0.306.0> FHC write buffering: ON 2026-03-30 03:53:17.685702+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit 2026-03-30 03:53:17.685769+00:00 [info] <0.282.0> Will use 4 processes for default worker pool 2026-03-30 03:53:17.685814+00:00 [info] <0.282.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-03-30 03:53:17.686166+00:00 [info] <0.222.0> Running boot step database defined by app rabbit 2026-03-30 03:53:17.687948+00:00 [info] <0.222.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2026-03-30 03:53:17.688042+00:00 [info] <0.222.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2026-03-30 03:53:17.688081+00:00 [info] <0.222.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:53:17.692082+00:00 [info] <0.222.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5563-1, contrail@cn-jenkins-deploy-platform-ansible-os-5563-2, contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 2026-03-30 03:53:17.692182+00:00 [info] <0.222.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5563-1, contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 2026-03-30 03:53:17.695547+00:00 [info] <0.222.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' selected for auto-clustering 2026-03-30 03:53:17.716528+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:53:17.716743+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:53:18.532797+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:53:18.532906+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:53:18.532967+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2-feature_flags`: 2026-03-30 03:53:18.533016+00:00 [warning] <0.222.0> Feature flags: - list of previously enabled feature flags now marked as such: [maintenance_mode_status, 2026-03-30 03:53:18.533016+00:00 [warning] <0.222.0> quorum_queue, 2026-03-30 03:53:18.533016+00:00 [warning] <0.222.0> user_limits, 2026-03-30 03:53:18.533016+00:00 [warning] <0.222.0> virtual_host_metadata] 2026-03-30 03:53:18.534497+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:18.534550+00:00 [info] <0.222.0> Feature flags: [ ] classic_mirrored_queue_version 2026-03-30 03:53:18.534580+00:00 [info] <0.222.0> Feature flags: [ ] drop_unroutable_metric 2026-03-30 03:53:18.534610+00:00 [info] <0.222.0> Feature flags: [ ] empty_basic_get_metric 2026-03-30 03:53:18.534653+00:00 [info] <0.222.0> Feature flags: [ ] implicit_default_bindings 2026-03-30 03:53:18.534672+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:53:18.534689+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:53:18.534732+00:00 [info] <0.222.0> Feature flags: [ ] stream_queue 2026-03-30 03:53:18.534750+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:53:18.534766+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:53:18.534791+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:18.564703+00:00 [info] <0.222.0> Feature flag `classic_mirrored_queue_version`: mark as enabled=true 2026-03-30 03:53:18.566605+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:18.566721+00:00 [info] <0.222.0> Feature flags: [x] classic_mirrored_queue_version 2026-03-30 03:53:18.566756+00:00 [info] <0.222.0> Feature flags: [ ] drop_unroutable_metric 2026-03-30 03:53:18.566802+00:00 [info] <0.222.0> Feature flags: [ ] empty_basic_get_metric 2026-03-30 03:53:18.566827+00:00 [info] <0.222.0> Feature flags: [ ] implicit_default_bindings 2026-03-30 03:53:18.566853+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:53:18.566877+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:53:18.566898+00:00 [info] <0.222.0> Feature flags: [ ] stream_queue 2026-03-30 03:53:18.566934+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:53:18.566957+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:53:18.566984+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:18.576698+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true 2026-03-30 03:53:18.583118+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:18.583205+00:00 [info] <0.222.0> Feature flags: [x] classic_mirrored_queue_version 2026-03-30 03:53:18.583240+00:00 [info] <0.222.0> Feature flags: [x] drop_unroutable_metric 2026-03-30 03:53:18.583276+00:00 [info] <0.222.0> Feature flags: [ ] empty_basic_get_metric 2026-03-30 03:53:18.583387+00:00 [info] <0.222.0> Feature flags: [ ] implicit_default_bindings 2026-03-30 03:53:18.583406+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:53:18.583422+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:53:18.583443+00:00 [info] <0.222.0> Feature flags: [ ] stream_queue 2026-03-30 03:53:18.583459+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:53:18.583483+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:53:18.583516+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:18.603909+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true 2026-03-30 03:53:18.610115+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:18.610191+00:00 [info] <0.222.0> Feature flags: [x] classic_mirrored_queue_version 2026-03-30 03:53:18.610221+00:00 [info] <0.222.0> Feature flags: [x] drop_unroutable_metric 2026-03-30 03:53:18.610263+00:00 [info] <0.222.0> Feature flags: [x] empty_basic_get_metric 2026-03-30 03:53:18.610334+00:00 [info] <0.222.0> Feature flags: [ ] implicit_default_bindings 2026-03-30 03:53:18.610363+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:53:18.610386+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:53:18.610434+00:00 [info] <0.222.0> Feature flags: [ ] stream_queue 2026-03-30 03:53:18.610459+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:53:18.610481+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:53:18.610515+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:18.624683+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2026-03-30 03:53:18.624797+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:53:18.624835+00:00 [info] <0.222.0> Feature flag `implicit_default_bindings`: mark as enabled=true 2026-03-30 03:53:18.626384+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:18.626435+00:00 [info] <0.222.0> Feature flags: [x] classic_mirrored_queue_version 2026-03-30 03:53:18.626457+00:00 [info] <0.222.0> Feature flags: [x] drop_unroutable_metric 2026-03-30 03:53:18.626474+00:00 [info] <0.222.0> Feature flags: [x] empty_basic_get_metric 2026-03-30 03:53:18.626516+00:00 [info] <0.222.0> Feature flags: [x] implicit_default_bindings 2026-03-30 03:53:18.626535+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:53:18.626551+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:53:18.626567+00:00 [info] <0.222.0> Feature flags: [ ] stream_queue 2026-03-30 03:53:18.626637+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:53:18.626653+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:53:18.626670+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:18.636510+00:00 [info] <0.222.0> Feature flag `stream_queue`: mark as enabled=true 2026-03-30 03:53:18.639844+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:53:18.639924+00:00 [info] <0.222.0> Feature flags: [x] classic_mirrored_queue_version 2026-03-30 03:53:18.639946+00:00 [info] <0.222.0> Feature flags: [x] drop_unroutable_metric 2026-03-30 03:53:18.639965+00:00 [info] <0.222.0> Feature flags: [x] empty_basic_get_metric 2026-03-30 03:53:18.639982+00:00 [info] <0.222.0> Feature flags: [x] implicit_default_bindings 2026-03-30 03:53:18.639999+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:53:18.640016+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:53:18.640031+00:00 [info] <0.222.0> Feature flags: [x] stream_queue 2026-03-30 03:53:18.640055+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:53:18.640070+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:53:18.640085+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:53:18.648690+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:53:18.648826+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:53:18.677800+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:53:18.677987+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:53:18.696752+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.708765+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.727044+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.728623+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration. 2026-03-30 03:53:18.728676+00:00 [info] <0.222.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config 2026-03-30 03:53:18.738959+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit 2026-03-30 03:53:18.739117+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit 2026-03-30 03:53:18.739272+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-30 03:53:18.739326+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit 2026-03-30 03:53:18.739348+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit 2026-03-30 03:53:18.739449+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit 2026-03-30 03:53:18.739543+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-30 03:53:18.739603+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-30 03:53:18.739644+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-30 03:53:18.739676+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-30 03:53:18.739741+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-30 03:53:18.739775+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-30 03:53:18.739814+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-30 03:53:18.739843+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-30 03:53:18.739874+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-30 03:53:18.739910+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-30 03:53:18.739941+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-30 03:53:18.739963+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-30 03:53:18.740072+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-30 03:53:18.740190+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-30 03:53:18.740295+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-30 03:53:18.740347+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit 2026-03-30 03:53:18.740367+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-30 03:53:18.740557+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-30 03:53:18.741235+00:00 [info] <0.500.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-03-30 03:53:18.741410+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit 2026-03-30 03:53:18.748836+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-30 03:53:18.755870+00:00 [info] <0.504.0> Starting rabbit_node_monitor 2026-03-30 03:53:18.756040+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit 2026-03-30 03:53:18.756491+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-30 03:53:18.756700+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit 2026-03-30 03:53:18.756764+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit 2026-03-30 03:53:18.756787+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit 2026-03-30 03:53:18.772554+00:00 [info] <0.222.0> message_store upgrades: 1 to apply 2026-03-30 03:53:18.772759+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-03-30 03:53:18.772946+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-03-30 03:53:18.773027+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data 2026-03-30 03:53:18.773470+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully 2026-03-30 03:53:18.786915+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit 2026-03-30 03:53:18.795241+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.823615+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.823909+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit 2026-03-30 03:53:18.823981+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit 2026-03-30 03:53:18.824807+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.825347+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.825793+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:53:18.826052+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-30 03:53:18.826110+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit 2026-03-30 03:53:18.826271+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-30 03:53:18.826358+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-30 03:53:18.826523+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit 2026-03-30 03:53:18.826765+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit 2026-03-30 03:53:18.826805+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-30 03:53:18.828364+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit 2026-03-30 03:53:18.828451+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit 2026-03-30 03:53:18.828602+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-30 03:53:18.828671+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-03-30 03:53:18.828727+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-03-30 03:53:18.828757+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored. 2026-03-30 03:53:18.828757+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-03-30 03:53:18.828789+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic' 2026-03-30 03:53:18.830608+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit 2026-03-30 03:53:18.831978+00:00 [info] <0.553.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-30 03:53:18.832669+00:00 [info] <0.553.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048' 2026-03-30 03:53:18.836898+00:00 [info] <0.553.0> Starting message stores for vhost '/' 2026-03-30 03:53:18.837184+00:00 [info] <0.558.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:53:18.838376+00:00 [info] <0.553.0> Started message store of type transient for vhost '/' 2026-03-30 03:53:18.838587+00:00 [info] <0.562.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:53:18.839070+00:00 [warning] <0.562.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-03-30 03:53:18.839755+00:00 [info] <0.553.0> Started message store of type persistent for vhost '/' 2026-03-30 03:53:18.839889+00:00 [info] <0.553.0> Recovering 0 queues of type rabbit_classic_queue took 6ms 2026-03-30 03:53:18.839936+00:00 [info] <0.553.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2026-03-30 03:53:18.839962+00:00 [info] <0.553.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2026-03-30 03:53:18.841280+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit 2026-03-30 03:53:18.841334+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load... 2026-03-30 03:53:18.841356+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-30 03:53:18.841380+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-30 03:53:18.841446+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit 2026-03-30 03:53:18.841547+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit 2026-03-30 03:53:18.841572+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit 2026-03-30 03:53:18.841598+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit 2026-03-30 03:53:18.841621+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit 2026-03-30 03:53:18.841686+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit 2026-03-30 03:53:18.842311+00:00 [info] <0.504.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' up 2026-03-30 03:53:18.842930+00:00 [info] <0.282.0> Starting worker pool 'definition_import_pool' with 4 processes in it 2026-03-30 03:53:18.843353+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit 2026-03-30 03:53:18.843402+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit 2026-03-30 03:53:18.843478+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit 2026-03-30 03:53:18.843515+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status` 2026-03-30 03:53:18.844044+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management 2026-03-30 03:53:18.844375+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json' 2026-03-30 03:53:18.844418+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal 2026-03-30 03:53:18.844486+00:00 [info] <0.222.0> Importing concurrently 1 users... 2026-03-30 03:53:18.857969+00:00 [info] <0.222.0> Importing concurrently 1 vhosts... 2026-03-30 03:53:18.863415+00:00 [info] <0.222.0> Importing concurrently 1 permissions... 2026-03-30 03:53:18.867358+00:00 [info] <0.586.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*' 2026-03-30 03:53:18.867562+00:00 [info] <0.222.0> Importing sequentially 1 policies... 2026-03-30 03:53:18.871657+00:00 [info] <0.597.0> Resetting node maintenance status 2026-03-30 03:53:18.883646+00:00 [info] <0.656.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-03-30 03:53:18.883805+00:00 [info] <0.684.0> Statistics database started. 2026-03-30 03:53:18.883871+00:00 [info] <0.683.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-03-30 03:53:18.895409+00:00 [info] <0.698.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692 2026-03-30 03:53:18.895597+00:00 [info] <0.597.0> Ready to start client connection listeners 2026-03-30 03:53:18.896698+00:00 [info] <0.742.0> started TCP listener on 10.0.0.241:5673 2026-03-30 03:53:18.977467+00:00 [info] <0.597.0> Server startup complete; 4 plugins started. 2026-03-30 03:53:18.977467+00:00 [info] <0.597.0> * rabbitmq_prometheus 2026-03-30 03:53:18.977467+00:00 [info] <0.597.0> * rabbitmq_management 2026-03-30 03:53:18.977467+00:00 [info] <0.597.0> * rabbitmq_web_dispatch 2026-03-30 03:53:18.977467+00:00 [info] <0.597.0> * rabbitmq_management_agent 2026-03-30 03:54:02.841935+00:00 [info] <0.933.0> RabbitMQ is asked to stop... 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> Stopping RabbitMQ applications and their dependencies in the following order: 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbitmq_management 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbitmq_prometheus 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbitmq_web_dispatch 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> cowboy 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> cowlib 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbitmq_management_agent 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbit 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> amqp_client 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbitmq_prelaunch 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> rabbit_common 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> prometheus 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> ra 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> accept 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> os_mon 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> sysmon_handler 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> osiris 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> mnesia 2026-03-30 03:54:02.894612+00:00 [info] <0.933.0> 2026-03-30 03:54:02.894783+00:00 [info] <0.933.0> Stopping application 'rabbitmq_management' 2026-03-30 03:54:02.904736+00:00 [warning] <0.648.0> HTTP listener registry could not find context rabbitmq_management_tls 2026-03-30 03:54:02.906474+00:00 [notice] <0.44.0> Application rabbitmq_management exited with reason: stopped 2026-03-30 03:54:02.906577+00:00 [info] <0.933.0> Stopping application 'rabbitmq_prometheus' 2026-03-30 03:54:02.907999+00:00 [warning] <0.648.0> HTTP listener registry could not find context rabbitmq_prometheus_tls 2026-03-30 03:54:02.909800+00:00 [notice] <0.44.0> Application rabbitmq_prometheus exited with reason: stopped 2026-03-30 03:54:02.909877+00:00 [info] <0.933.0> Stopping application 'rabbitmq_web_dispatch' 2026-03-30 03:54:02.911755+00:00 [notice] <0.44.0> Application rabbitmq_web_dispatch exited with reason: stopped 2026-03-30 03:54:02.911831+00:00 [info] <0.933.0> Stopping application 'cowboy' 2026-03-30 03:54:02.913319+00:00 [notice] <0.44.0> Application cowboy exited with reason: stopped 2026-03-30 03:54:02.913402+00:00 [info] <0.933.0> Stopping application 'cowlib' 2026-03-30 03:54:02.913449+00:00 [notice] <0.44.0> Application cowlib exited with reason: stopped 2026-03-30 03:54:02.913519+00:00 [info] <0.933.0> Stopping application 'rabbitmq_management_agent' 2026-03-30 03:54:02.915732+00:00 [notice] <0.44.0> Application rabbitmq_management_agent exited with reason: stopped 2026-03-30 03:54:02.915794+00:00 [info] <0.933.0> Stopping application 'rabbit' 2026-03-30 03:54:02.915931+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping unregistration. 2026-03-30 03:54:02.916093+00:00 [info] <0.742.0> stopped TCP listener on 10.0.0.241:5673 2026-03-30 03:54:02.916962+00:00 [info] <0.934.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' because the vhost is stopping 2026-03-30 03:54:02.917047+00:00 [info] <0.562.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2026-03-30 03:54:02.922153+00:00 [info] <0.562.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2026-03-30 03:54:02.922318+00:00 [info] <0.558.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2026-03-30 03:54:02.926712+00:00 [info] <0.558.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2026-03-30 03:54:02.927523+00:00 [info] <0.495.0> Management plugin: to stop collect_statistics. 2026-03-30 03:54:07.931737+00:00 [notice] <0.44.0> Application rabbit exited with reason: stopped 2026-03-30 03:54:07.931922+00:00 [info] <0.933.0> Stopping application 'amqp_client' 2026-03-30 03:54:07.933695+00:00 [notice] <0.44.0> Application amqp_client exited with reason: stopped 2026-03-30 03:54:07.933836+00:00 [info] <0.933.0> Stopping application 'rabbitmq_prelaunch' 2026-03-30 03:54:07.935876+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: stopped 2026-03-30 03:54:07.935950+00:00 [info] <0.933.0> Stopping application 'rabbit_common' 2026-03-30 03:54:07.935981+00:00 [notice] <0.44.0> Application rabbit_common exited with reason: stopped 2026-03-30 03:54:07.936027+00:00 [info] <0.933.0> Stopping application 'prometheus' 2026-03-30 03:54:07.937996+00:00 [notice] <0.44.0> Application prometheus exited with reason: stopped 2026-03-30 03:54:07.938071+00:00 [info] <0.933.0> Stopping application 'ra' 2026-03-30 03:54:07.941784+00:00 [notice] <0.44.0> Application ra exited with reason: stopped 2026-03-30 03:54:07.941863+00:00 [info] <0.933.0> Stopping application 'accept' 2026-03-30 03:54:07.941894+00:00 [notice] <0.44.0> Application accept exited with reason: stopped 2026-03-30 03:54:07.941917+00:00 [info] <0.933.0> Stopping application 'os_mon' 2026-03-30 03:54:07.944021+00:00 [notice] <0.44.0> Application os_mon exited with reason: stopped 2026-03-30 03:54:07.944141+00:00 [info] <0.933.0> Stopping application 'sysmon_handler' 2026-03-30 03:54:07.945895+00:00 [notice] <0.44.0> Application sysmon_handler exited with reason: stopped 2026-03-30 03:54:07.946027+00:00 [info] <0.933.0> Stopping application 'osiris' 2026-03-30 03:54:07.947883+00:00 [notice] <0.44.0> Application osiris exited with reason: stopped 2026-03-30 03:54:07.947981+00:00 [info] <0.933.0> Stopping application 'mnesia' 2026-03-30 03:54:07.951071+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-30 03:54:07.951161+00:00 [info] <0.933.0> Successfully stopped RabbitMQ and its dependencies 2026-03-30 03:54:17.374251+00:00 [info] <0.981.0> Resetting Rabbit forcefully 2026-03-30 03:54:17.892543+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-30 03:54:17.899381+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-30 03:54:18.029994+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.030101+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.040755+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.040891+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.041063+00:00 [warning] <0.987.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2-feature_flags`: 2026-03-30 03:54:18.041134+00:00 [warning] <0.987.0> Feature flags: - list of previously disabled feature flags now marked as such: [maintenance_mode_status] 2026-03-30 03:54:18.043753+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.043897+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.055827+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2026-03-30 03:54:18.055946+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.061221+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-30 03:54:18.071598+00:00 [info] <0.987.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-5563-1'] as disc node 2026-03-30 03:54:18.093200+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.093379+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.373789+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.374133+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.374205+00:00 [warning] <0.987.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2-feature_flags`: 2026-03-30 03:54:18.374250+00:00 [warning] <0.987.0> Feature flags: - list of previously enabled feature flags now marked as such: [maintenance_mode_status] 2026-03-30 03:54:18.377293+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.377477+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.393035+00:00 [info] <0.987.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:18.393368+00:00 [info] <0.987.0> Successfully synced tables from a peer 2026-03-30 03:54:18.400347+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-30 03:54:18.400543+00:00 [error] <0.987.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': {node_not_running, 2026-03-30 03:54:18.400543+00:00 [error] <0.987.0> 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2'} 2026-03-30 03:54:18.400781+00:00 [info] <0.987.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:18.400913+00:00 [error] <0.987.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': {node_not_running, 2026-03-30 03:54:18.400913+00:00 [error] <0.987.0> 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2'} 2026-03-30 03:54:18.401019+00:00 [info] <0.987.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:18.401091+00:00 [error] <0.987.0> Failed to create a per-user tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': {node_not_running, 2026-03-30 03:54:18.401091+00:00 [error] <0.987.0> 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2'} 2026-03-30 03:54:18.401161+00:00 [info] <0.987.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> Halting Erlang VM with the following applications: 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> amqp10_common 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> observer_cli 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> stdout_formatter 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> seshat 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> gen_batch_server 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> aten 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> ranch 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> inets 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> systemd 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> enough 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> cuttlefish 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> credentials_obfuscation 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> recon 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> jsx 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> xmerl 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> tools 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> syntax_tools 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> ssl 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> public_key 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> asn1 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> crypto 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> compiler 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> sasl 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> stdlib 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> kernel 2026-03-30 03:54:18.901849+00:00 [info] <0.1345.0> 2026-03-30 03:54:22.967673+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE 2026-03-30 03:54:24.621544+00:00 [info] <0.222.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2-upgrade-backup" 2026-03-30 03:54:24.625216+00:00 [info] <0.222.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2-upgrade-backup" 2026-03-30 03:54:24.635793+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2026-03-30 03:54:24.637106+00:00 [info] <0.222.0> Feature flags: list of feature flags found: 2026-03-30 03:54:24.637159+00:00 [info] <0.222.0> Feature flags: [x] classic_mirrored_queue_version 2026-03-30 03:54:24.637211+00:00 [info] <0.222.0> Feature flags: [x] drop_unroutable_metric 2026-03-30 03:54:24.637230+00:00 [info] <0.222.0> Feature flags: [x] empty_basic_get_metric 2026-03-30 03:54:24.637246+00:00 [info] <0.222.0> Feature flags: [x] implicit_default_bindings 2026-03-30 03:54:24.637300+00:00 [info] <0.222.0> Feature flags: [x] maintenance_mode_status 2026-03-30 03:54:24.637322+00:00 [info] <0.222.0> Feature flags: [x] quorum_queue 2026-03-30 03:54:24.637337+00:00 [info] <0.222.0> Feature flags: [x] stream_queue 2026-03-30 03:54:24.637354+00:00 [info] <0.222.0> Feature flags: [x] user_limits 2026-03-30 03:54:24.637412+00:00 [info] <0.222.0> Feature flags: [x] virtual_host_metadata 2026-03-30 03:54:24.637430+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes 2026-03-30 03:54:24.686653+00:00 [info] <0.222.0> ra: starting system quorum_queues 2026-03-30 03:54:24.686807+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:54:24.687616+00:00 [info] <0.309.0> ra system 'quorum_queues' running pre init for 0 registered servers 2026-03-30 03:54:24.689781+00:00 [info] <0.310.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered 2026-03-30 03:54:24.689992+00:00 [notice] <0.315.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables 2026-03-30 03:54:24.695019+00:00 [info] <0.222.0> ra: starting system coordination 2026-03-30 03:54:24.695088+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:54:24.696115+00:00 [info] <0.336.0> ra system 'coordination' running pre init for 0 registered servers 2026-03-30 03:54:24.696668+00:00 [info] <0.337.0> ra: meta data store initialised for system coordination. 0 record(s) recovered 2026-03-30 03:54:24.696882+00:00 [notice] <0.342.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables 2026-03-30 03:54:24.702012+00:00 [info] <0.222.0> 2026-03-30 03:54:24.702012+00:00 [info] <0.222.0> Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit] 2026-03-30 03:54:24.702012+00:00 [info] <0.222.0> Copyright (c) 2007-2022 VMware, Inc. or its affiliates. 2026-03-30 03:54:24.702012+00:00 [info] <0.222.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> home dir : /var/lib/rabbitmq 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> config file(s) : /etc/rabbitmq/rabbitmq.config 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> : /etc/rabbitmq/conf.d/10-defaults.conf 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> cookie hash : esZsDxSN6VGbi9JkMSxNZA== 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2_upgrade.log 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> : 2026-03-30 03:54:24.704211+00:00 [info] <0.222.0> database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2 2026-03-30 03:54:24.901490+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true 2026-03-30 03:54:24.903253+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true 2026-03-30 03:54:25.139753+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit 2026-03-30 03:54:25.139865+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit 2026-03-30 03:54:25.140217+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit 2026-03-30 03:54:25.140401+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit 2026-03-30 03:54:25.140851+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit 2026-03-30 03:54:25.143961+00:00 [info] <0.415.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2026-03-30 03:54:25.153009+00:00 [info] <0.417.0> Enabling free disk space monitoring 2026-03-30 03:54:25.153092+00:00 [info] <0.417.0> Disk free limit set to 50MB 2026-03-30 03:54:25.163373+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit 2026-03-30 03:54:25.163526+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit 2026-03-30 03:54:25.163814+00:00 [info] <0.422.0> Limiting to approx 927 file handles (832 sockets) 2026-03-30 03:54:25.163952+00:00 [info] <0.423.0> FHC read buffering: OFF 2026-03-30 03:54:25.163995+00:00 [info] <0.423.0> FHC write buffering: ON 2026-03-30 03:54:25.164446+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit 2026-03-30 03:54:25.164501+00:00 [info] <0.358.0> Will use 4 processes for default worker pool 2026-03-30 03:54:25.164536+00:00 [info] <0.358.0> Starting worker pool 'worker_pool' with 4 processes in it 2026-03-30 03:54:25.164928+00:00 [info] <0.222.0> Running boot step database defined by app rabbit 2026-03-30 03:54:25.169157+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:25.171665+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:54:25.172282+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:25.172389+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:54:25.172433+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2-feature_flags`: 2026-03-30 03:54:25.172464+00:00 [warning] <0.222.0> Feature flags: - list of previously disabled feature flags now marked as such: [empty_basic_get_metric] 2026-03-30 03:54:25.181142+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:25.181334+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:54:25.216652+00:00 [info] <0.222.0> upgrades: Mnesia backup removed 2026-03-30 03:54:25.216738+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2026-03-30 03:54:25.216876+00:00 [info] <0.222.0> Successfully synced tables from a peer 2026-03-30 03:54:25.216905+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration. 2026-03-30 03:54:25.217023+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit 2026-03-30 03:54:25.217197+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit 2026-03-30 03:54:25.217433+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit 2026-03-30 03:54:25.217514+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit 2026-03-30 03:54:25.217552+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit 2026-03-30 03:54:25.217781+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit 2026-03-30 03:54:25.217911+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2026-03-30 03:54:25.217984+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2026-03-30 03:54:25.218085+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2026-03-30 03:54:25.218154+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2026-03-30 03:54:25.218274+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2026-03-30 03:54:25.218357+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2026-03-30 03:54:25.218442+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2026-03-30 03:54:25.218536+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2026-03-30 03:54:25.218591+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2026-03-30 03:54:25.218649+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2026-03-30 03:54:25.218708+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit 2026-03-30 03:54:25.218780+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue 2026-03-30 03:54:25.218855+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2026-03-30 03:54:25.218943+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2026-03-30 03:54:25.218991+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit 2026-03-30 03:54:25.219059+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit 2026-03-30 03:54:25.219080+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2026-03-30 03:54:25.219264+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2026-03-30 03:54:25.220560+00:00 [info] <0.447.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2026-03-30 03:54:25.220686+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit 2026-03-30 03:54:25.224268+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit 2026-03-30 03:54:25.224887+00:00 [info] <0.451.0> Starting rabbit_node_monitor 2026-03-30 03:54:25.224993+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit 2026-03-30 03:54:25.225471+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit 2026-03-30 03:54:25.225717+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit 2026-03-30 03:54:25.225832+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit 2026-03-30 03:54:25.225863+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit 2026-03-30 03:54:25.235452+00:00 [info] <0.222.0> message_store upgrades: 1 to apply 2026-03-30 03:54:25.235673+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2026-03-30 03:54:25.235887+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration 2026-03-30 03:54:25.235949+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data 2026-03-30 03:54:25.236501+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully 2026-03-30 03:54:25.254619+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit 2026-03-30 03:54:25.263182+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:25.269832+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:25.270102+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit 2026-03-30 03:54:25.270164+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit 2026-03-30 03:54:25.276713+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:25.283066+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:25.292214+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5563-2' 2026-03-30 03:54:25.292536+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2026-03-30 03:54:25.292629+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit 2026-03-30 03:54:25.292680+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2026-03-30 03:54:25.292767+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2026-03-30 03:54:25.292950+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit 2026-03-30 03:54:25.293193+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit 2026-03-30 03:54:25.293239+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2026-03-30 03:54:25.293293+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit 2026-03-30 03:54:25.293337+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit 2026-03-30 03:54:25.293465+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit 2026-03-30 03:54:25.293521+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2026-03-30 03:54:25.293553+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2026-03-30 03:54:25.293613+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored. 2026-03-30 03:54:25.293613+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application. 2026-03-30 03:54:25.293653+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic' 2026-03-30 03:54:25.296350+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit 2026-03-30 03:54:25.297661+00:00 [info] <0.509.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5563-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2026-03-30 03:54:25.298549+00:00 [info] <0.509.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048' 2026-03-30 03:54:25.302478+00:00 [info] <0.509.0> Starting message stores for vhost '/' 2026-03-30 03:54:25.302787+00:00 [info] <0.514.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:54:25.303736+00:00 [info] <0.509.0> Started message store of type transient for vhost '/' 2026-03-30 03:54:25.303957+00:00 [info] <0.518.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2026-03-30 03:54:25.304655+00:00 [warning] <0.518.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2026-03-30 03:54:25.305322+00:00 [info] <0.509.0> Started message store of type persistent for vhost '/' 2026-03-30 03:54:25.305476+00:00 [info] <0.509.0> Recovering 0 queues of type rabbit_classic_queue took 6ms 2026-03-30 03:54:25.305517+00:00 [info] <0.509.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2026-03-30 03:54:25.305552+00:00 [info] <0.509.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2026-03-30 03:54:25.307245+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.538.0> 2026-03-30 03:54:25.307452+00:00 [info] <0.509.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.542.0> 2026-03-30 03:54:25.307636+00:00 [info] <0.509.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.546.0> 2026-03-30 03:54:25.307863+00:00 [info] <0.509.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.550.0> 2026-03-30 03:54:25.308070+00:00 [info] <0.509.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.554.0> 2026-03-30 03:54:25.308385+00:00 [info] <0.509.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.558.0> 2026-03-30 03:54:25.308600+00:00 [info] <0.509.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.562.0> 2026-03-30 03:54:25.308804+00:00 [info] <0.509.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.566.0> 2026-03-30 03:54:25.308962+00:00 [info] <0.509.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.570.0> 2026-03-30 03:54:25.309217+00:00 [info] <0.509.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.574.0> 2026-03-30 03:54:25.309499+00:00 [info] <0.509.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.581.0> 2026-03-30 03:54:25.309883+00:00 [info] <0.509.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.585.0> 2026-03-30 03:54:25.310251+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.590.0> 2026-03-30 03:54:25.310584+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.594.0> 2026-03-30 03:54:25.310985+00:00 [info] <0.509.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.598.0> 2026-03-30 03:54:25.311830+00:00 [info] <0.509.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.602.0> 2026-03-30 03:54:25.312662+00:00 [info] <0.509.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.612.0> 2026-03-30 03:54:25.312907+00:00 [info] <0.509.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.618.0> 2026-03-30 03:54:25.313786+00:00 [info] <0.509.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.622.0> 2026-03-30 03:54:25.318332+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.631.0> 2026-03-30 03:54:25.319260+00:00 [info] <0.509.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.640.0> 2026-03-30 03:54:25.320137+00:00 [info] <0.509.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.644.0> 2026-03-30 03:54:25.320880+00:00 [info] <0.509.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.649.0> 2026-03-30 03:54:25.321551+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.656.0> 2026-03-30 03:54:25.322436+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.666.0> 2026-03-30 03:54:25.326284+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.676.0> 2026-03-30 03:54:25.326606+00:00 [info] <0.509.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.682.0> 2026-03-30 03:54:25.326871+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.686.0> 2026-03-30 03:54:25.327137+00:00 [info] <0.509.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.690.0> 2026-03-30 03:54:25.331957+00:00 [info] <0.509.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.694.0> 2026-03-30 03:54:25.332236+00:00 [info] <0.509.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.701.0> 2026-03-30 03:54:25.332461+00:00 [info] <0.509.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.705.0> 2026-03-30 03:54:25.332890+00:00 [info] <0.509.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-2': <0.709.0> 2026-03-30 03:54:25.333003+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit 2026-03-30 03:54:25.333040+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load... 2026-03-30 03:54:25.333073+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit 2026-03-30 03:54:25.333096+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2026-03-30 03:54:25.333166+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit 2026-03-30 03:54:25.333327+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit 2026-03-30 03:54:25.333355+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit 2026-03-30 03:54:25.333400+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit 2026-03-30 03:54:25.333431+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit 2026-03-30 03:54:25.333526+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit 2026-03-30 03:54:25.333596+00:00 [info] <0.358.0> Starting worker pool 'definition_import_pool' with 4 processes in it 2026-03-30 03:54:25.333808+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit 2026-03-30 03:54:25.333856+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit 2026-03-30 03:54:25.333906+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit 2026-03-30 03:54:25.333932+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status` 2026-03-30 03:54:25.333904+00:00 [info] <0.451.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-1' up 2026-03-30 03:54:25.346858+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management 2026-03-30 03:54:25.347792+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json' 2026-03-30 03:54:25.347934+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal 2026-03-30 03:54:25.348045+00:00 [info] <0.222.0> Importing concurrently 1 users... 2026-03-30 03:54:25.358931+00:00 [info] <0.222.0> Importing concurrently 1 vhosts... 2026-03-30 03:54:25.366851+00:00 [info] <0.222.0> Importing concurrently 1 permissions... 2026-03-30 03:54:25.379774+00:00 [info] <0.717.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*' 2026-03-30 03:54:25.380078+00:00 [info] <0.222.0> Importing sequentially 1 policies... 2026-03-30 03:54:25.443099+00:00 [info] <0.822.0> Resetting node maintenance status 2026-03-30 03:54:25.475605+00:00 [info] <0.884.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2026-03-30 03:54:25.475890+00:00 [info] <0.912.0> Statistics database started. 2026-03-30 03:54:25.476048+00:00 [info] <0.911.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2026-03-30 03:54:25.485401+00:00 [info] <0.926.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692 2026-03-30 03:54:25.485633+00:00 [info] <0.822.0> Ready to start client connection listeners 2026-03-30 03:54:25.486797+00:00 [info] <0.970.0> started TCP listener on 10.0.0.241:5673 2026-03-30 03:54:25.590540+00:00 [info] <0.822.0> Server startup complete; 4 plugins started. 2026-03-30 03:54:25.590540+00:00 [info] <0.822.0> * rabbitmq_prometheus 2026-03-30 03:54:25.590540+00:00 [info] <0.822.0> * rabbitmq_management 2026-03-30 03:54:25.590540+00:00 [info] <0.822.0> * rabbitmq_web_dispatch 2026-03-30 03:54:25.590540+00:00 [info] <0.822.0> * rabbitmq_management_agent 2026-03-30 03:54:51.838724+00:00 [info] <0.451.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:54:52.455161+00:00 [info] <0.451.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:55:44.520418+00:00 [info] <0.686.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.522004+00:00 [info] <0.705.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-1' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.522756+00:00 [info] <0.676.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.523059+00:00 [info] <0.682.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.523063+00:00 [info] <0.554.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-1..dummy' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.527664+00:00 [info] <0.640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.530699+00:00 [info] <0.690.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.530782+00:00 [info] <0.574.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.531139+00:00 [info] <0.709.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5563-2' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.534224+00:00 [info] <0.656.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.541657+00:00 [info] <0.666.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5563-1.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.541641+00:00 [info] <0.612.0> Mirrored queue 'job_request_consumer' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.541760+00:00 [info] <0.538.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-2.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.545086+00:00 [info] <0.590.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5563-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5563-3.' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.545450+00:00 [info] <0.546.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5563-3..dummy' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.545482+00:00 [info] <0.649.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5563-1.-8082-0' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:44.545998+00:00 [info] <0.566.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5563-2..config_queue' in vhost '/': Secondary replica of queue detected replica to be down 2026-03-30 03:55:49.403706+00:00 [info] <0.451.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' down 2026-03-30 03:55:49.412559+00:00 [info] <0.451.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-5563-3 listeners: the node is already back 2026-03-30 03:55:56.886687+00:00 [info] <0.451.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' down: connection_closed 2026-03-30 03:55:57.406317+00:00 [info] <0.451.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:55:58.539104+00:00 [info] <0.451.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' down: connection_closed 2026-03-30 03:56:04.872905+00:00 [info] <0.451.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up 2026-03-30 03:56:05.605178+00:00 [info] <0.451.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5563-3' up