2026-03-02 02:04:24.181740+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2026-03-02 02:04:24.390897+00:00 [info] <0.222.0> ra: starting system quorum_queues
2026-03-02 02:04:24.391009+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:04:24.490812+00:00 [info] <0.259.0> ra system 'quorum_queues' running pre init for 0 registered servers
2026-03-02 02:04:24.505469+00:00 [info] <0.260.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2026-03-02 02:04:24.520864+00:00 [notice] <0.265.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2026-03-02 02:04:24.529655+00:00 [info] <0.222.0> ra: starting system coordination
2026-03-02 02:04:24.529736+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:04:24.530694+00:00 [info] <0.272.0> ra system 'coordination' running pre init for 0 registered servers
2026-03-02 02:04:24.531264+00:00 [info] <0.273.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2026-03-02 02:04:24.531437+00:00 [notice] <0.278.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2026-03-02 02:04:24.535343+00:00 [info] <0.222.0> 
2026-03-02 02:04:24.535343+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2026-03-02 02:04:24.535343+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2026-03-02 02:04:24.535343+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0> 
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3_upgrade.log
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>                 : <stdout>
2026-03-02 02:04:24.536824+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:04:24.817415+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:24.817494+00:00 [info] <0.222.0> Feature flags:   [ ] classic_mirrored_queue_version
2026-03-02 02:04:24.817521+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2026-03-02 02:04:24.817553+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-03-02 02:04:24.817609+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-03-02 02:04:24.817629+00:00 [info] <0.222.0> Feature flags:   [ ] maintenance_mode_status
2026-03-02 02:04:24.817648+00:00 [info] <0.222.0> Feature flags:   [ ] quorum_queue
2026-03-02 02:04:24.817716+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-03-02 02:04:24.817737+00:00 [info] <0.222.0> Feature flags:   [ ] user_limits
2026-03-02 02:04:24.817754+00:00 [info] <0.222.0> Feature flags:   [ ] virtual_host_metadata
2026-03-02 02:04:24.817783+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:27.299760+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2026-03-02 02:04:27.299844+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2026-03-02 02:04:27.300212+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2026-03-02 02:04:27.300346+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2026-03-02 02:04:27.301004+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2026-03-02 02:04:27.304767+00:00 [info] <0.302.0> Memory high watermark set to 12637 MiB (13251084288 bytes) of 15796 MiB (16563855360 bytes) total
2026-03-02 02:04:27.308591+00:00 [info] <0.304.0> Enabling free disk space monitoring
2026-03-02 02:04:27.308657+00:00 [info] <0.304.0> Disk free limit set to 50MB
2026-03-02 02:04:27.311794+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2026-03-02 02:04:27.311916+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2026-03-02 02:04:27.312135+00:00 [info] <0.309.0> Limiting to approx 927 file handles (832 sockets)
2026-03-02 02:04:27.312250+00:00 [info] <0.310.0> FHC read buffering: OFF
2026-03-02 02:04:27.312286+00:00 [info] <0.310.0> FHC write buffering: ON
2026-03-02 02:04:27.312641+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2026-03-02 02:04:27.312695+00:00 [info] <0.280.0> Will use 4 processes for default worker pool
2026-03-02 02:04:27.312743+00:00 [info] <0.280.0> Starting worker pool 'worker_pool' with 4 processes in it
2026-03-02 02:04:27.313028+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2026-03-02 02:04:27.313347+00:00 [info] <0.222.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3 is empty. Assuming we need to join an existing cluster or initialise from scratch...
2026-03-02 02:04:27.313403+00:00 [info] <0.222.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config
2026-03-02 02:04:27.313430+00:00 [info] <0.222.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config
2026-03-02 02:04:31.920587+00:00 [info] <0.222.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-5413-1, contrail@cn-jenkins-deploy-platform-ansible-os-5413-2, contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:04:31.920738+00:00 [info] <0.222.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-5413-1, contrail@cn-jenkins-deploy-platform-ansible-os-5413-2
2026-03-02 02:04:31.924644+00:00 [info] <0.222.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-1' selected for auto-clustering
2026-03-02 02:04:31.959110+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:04:31.959324+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:04:32.277045+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:04:32.277177+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:04:32.277230+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3-feature_flags`:
2026-03-02 02:04:32.277297+00:00 [warning] <0.222.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status,
2026-03-02 02:04:32.277297+00:00 [warning] <0.222.0>                                                                                  quorum_queue,
2026-03-02 02:04:32.277297+00:00 [warning] <0.222.0>                                                                                  user_limits,
2026-03-02 02:04:32.277297+00:00 [warning] <0.222.0>                                                                                  virtual_host_metadata]
2026-03-02 02:04:32.278534+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:32.278603+00:00 [info] <0.222.0> Feature flags:   [ ] classic_mirrored_queue_version
2026-03-02 02:04:32.278642+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2026-03-02 02:04:32.278677+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-03-02 02:04:32.278700+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-03-02 02:04:32.278760+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:04:32.278785+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:04:32.278841+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-03-02 02:04:32.278866+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:04:32.278896+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:04:32.278972+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:32.287645+00:00 [info] <0.222.0> Feature flag `classic_mirrored_queue_version`: mark as enabled=true
2026-03-02 02:04:32.290199+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:32.290277+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-03-02 02:04:32.290312+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2026-03-02 02:04:32.290361+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-03-02 02:04:32.290433+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-03-02 02:04:32.290462+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:04:32.290491+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:04:32.290514+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-03-02 02:04:32.290574+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:04:32.290598+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:04:32.290637+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:32.299185+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true
2026-03-02 02:04:32.300965+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:32.301035+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-03-02 02:04:32.301061+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-03-02 02:04:32.301099+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2026-03-02 02:04:32.301123+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-03-02 02:04:32.301143+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:04:32.301162+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:04:32.301190+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-03-02 02:04:32.301209+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:04:32.301227+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:04:32.301255+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:32.310391+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true
2026-03-02 02:04:32.312346+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:32.312414+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-03-02 02:04:32.312441+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-03-02 02:04:32.312491+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-03-02 02:04:32.312532+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2026-03-02 02:04:32.312553+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:04:32.312572+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:04:32.312622+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-03-02 02:04:32.312642+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:04:32.312659+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:04:32.312688+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:32.322347+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2026-03-02 02:04:32.322465+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:04:32.322518+00:00 [info] <0.222.0> Feature flag `implicit_default_bindings`: mark as enabled=true
2026-03-02 02:04:32.324287+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:32.324352+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-03-02 02:04:32.324379+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-03-02 02:04:32.324400+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-03-02 02:04:32.324451+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2026-03-02 02:04:32.324473+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:04:32.324526+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:04:32.324554+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2026-03-02 02:04:32.324614+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:04:32.324632+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:04:32.324650+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:32.333312+00:00 [info] <0.222.0> Feature flag `stream_queue`: mark as enabled=true
2026-03-02 02:04:32.334926+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:04:32.335008+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-03-02 02:04:32.335036+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-03-02 02:04:32.335063+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-03-02 02:04:32.335085+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2026-03-02 02:04:32.335113+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:04:32.335134+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:04:32.335175+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2026-03-02 02:04:32.335210+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:04:32.335228+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:04:32.335247+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:04:32.344238+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:04:32.344388+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:04:32.366974+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:04:32.367244+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:04:32.376383+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.398720+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.406315+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.407196+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2026-03-02 02:04:32.407252+00:00 [info] <0.222.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config
2026-03-02 02:04:32.407809+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2026-03-02 02:04:32.407926+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2026-03-02 02:04:32.408124+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2026-03-02 02:04:32.408164+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2026-03-02 02:04:32.408192+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2026-03-02 02:04:32.408297+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2026-03-02 02:04:32.408384+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2026-03-02 02:04:32.408487+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2026-03-02 02:04:32.408580+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2026-03-02 02:04:32.408676+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2026-03-02 02:04:32.408744+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2026-03-02 02:04:32.408789+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2026-03-02 02:04:32.408855+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2026-03-02 02:04:32.408904+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2026-03-02 02:04:32.408966+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2026-03-02 02:04:32.409034+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2026-03-02 02:04:32.409095+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2026-03-02 02:04:32.409122+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2026-03-02 02:04:32.409195+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2026-03-02 02:04:32.409243+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2026-03-02 02:04:32.409296+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2026-03-02 02:04:32.409338+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2026-03-02 02:04:32.409360+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2026-03-02 02:04:32.409510+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2026-03-02 02:04:32.410162+00:00 [info] <0.504.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2026-03-02 02:04:32.410261+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2026-03-02 02:04:32.413392+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2026-03-02 02:04:32.414377+00:00 [info] <0.508.0> Starting rabbit_node_monitor
2026-03-02 02:04:32.414496+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2026-03-02 02:04:32.414997+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2026-03-02 02:04:32.415168+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2026-03-02 02:04:32.415231+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2026-03-02 02:04:32.415258+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2026-03-02 02:04:32.422176+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2026-03-02 02:04:32.422308+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2026-03-02 02:04:32.422431+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2026-03-02 02:04:32.422478+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2026-03-02 02:04:32.422842+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2026-03-02 02:04:32.432828+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2026-03-02 02:04:32.440727+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.447900+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.448154+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2026-03-02 02:04:32.448260+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2026-03-02 02:04:32.449007+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.449567+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.450165+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:04:32.450404+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2026-03-02 02:04:32.450467+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2026-03-02 02:04:32.450565+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2026-03-02 02:04:32.450655+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2026-03-02 02:04:32.450826+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2026-03-02 02:04:32.451147+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2026-03-02 02:04:32.451216+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2026-03-02 02:04:32.451272+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2026-03-02 02:04:32.451342+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2026-03-02 02:04:32.451437+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2026-03-02 02:04:32.451501+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2026-03-02 02:04:32.451543+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2026-03-02 02:04:32.451573+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2026-03-02 02:04:32.451573+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2026-03-02 02:04:32.451615+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2026-03-02 02:04:32.452910+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2026-03-02 02:04:32.454854+00:00 [info] <0.557.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2026-03-02 02:04:32.455597+00:00 [info] <0.557.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2026-03-02 02:04:32.459950+00:00 [info] <0.557.0> Starting message stores for vhost '/'
2026-03-02 02:04:32.460223+00:00 [info] <0.562.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2026-03-02 02:04:32.461269+00:00 [info] <0.557.0> Started message store of type transient for vhost '/'
2026-03-02 02:04:32.461481+00:00 [info] <0.566.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2026-03-02 02:04:32.461979+00:00 [warning] <0.566.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2026-03-02 02:04:32.462638+00:00 [info] <0.557.0> Started message store of type persistent for vhost '/'
2026-03-02 02:04:32.462783+00:00 [info] <0.557.0> Recovering 0 queues of type rabbit_classic_queue took 6ms
2026-03-02 02:04:32.462816+00:00 [info] <0.557.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2026-03-02 02:04:32.462856+00:00 [info] <0.557.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2026-03-02 02:04:32.464037+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2026-03-02 02:04:32.464095+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2026-03-02 02:04:32.464128+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2026-03-02 02:04:32.464154+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2026-03-02 02:04:32.464284+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2026-03-02 02:04:32.464447+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2026-03-02 02:04:32.464517+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2026-03-02 02:04:32.464540+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2026-03-02 02:04:32.464563+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2026-03-02 02:04:32.464585+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2026-03-02 02:04:32.464624+00:00 [info] <0.280.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2026-03-02 02:04:32.464944+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2026-03-02 02:04:32.464979+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2026-03-02 02:04:32.465024+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2026-03-02 02:04:32.465069+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2026-03-02 02:04:32.465511+00:00 [info] <0.508.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' up
2026-03-02 02:04:32.466295+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2026-03-02 02:04:32.466712+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2026-03-02 02:04:32.466764+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2026-03-02 02:04:32.466858+00:00 [info] <0.222.0> Importing concurrently 1 users...
2026-03-02 02:04:32.472127+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2026-03-02 02:04:32.477638+00:00 [info] <0.508.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-1' up
2026-03-02 02:04:32.477702+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2026-03-02 02:04:32.481200+00:00 [info] <0.590.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2026-03-02 02:04:32.481370+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2026-03-02 02:04:32.489945+00:00 [info] <0.602.0> Resetting node maintenance status
2026-03-02 02:04:32.505002+00:00 [info] <0.661.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2026-03-02 02:04:32.505190+00:00 [info] <0.689.0> Statistics database started.
2026-03-02 02:04:32.505281+00:00 [info] <0.688.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2026-03-02 02:04:32.513764+00:00 [info] <0.703.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2026-03-02 02:04:32.514039+00:00 [info] <0.602.0> Ready to start client connection listeners
2026-03-02 02:04:32.515212+00:00 [info] <0.747.0> started TCP listener on 10.0.0.23:5673
2026-03-02 02:04:32.593198+00:00 [info] <0.602.0> Server startup complete; 4 plugins started.
2026-03-02 02:04:32.593198+00:00 [info] <0.602.0>  * rabbitmq_prometheus
2026-03-02 02:04:32.593198+00:00 [info] <0.602.0>  * rabbitmq_management
2026-03-02 02:04:32.593198+00:00 [info] <0.602.0>  * rabbitmq_web_dispatch
2026-03-02 02:04:32.593198+00:00 [info] <0.602.0>  * rabbitmq_management_agent
2026-03-02 02:05:14.332643+00:00 [info] <0.977.0> RabbitMQ is asked to stop...
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0> Stopping RabbitMQ applications and their dependencies in the following order:
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbitmq_management
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbitmq_prometheus
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbitmq_web_dispatch
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     cowboy
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     cowlib
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbitmq_management_agent
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbit
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     amqp_client
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbitmq_prelaunch
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     rabbit_common
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     prometheus
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     ra
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     accept
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     os_mon
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     sysmon_handler
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     osiris
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0>     mnesia
2026-03-02 02:05:14.507829+00:00 [info] <0.977.0> 
2026-03-02 02:05:14.507991+00:00 [info] <0.977.0> Stopping application 'rabbitmq_management'
2026-03-02 02:05:14.515820+00:00 [warning] <0.653.0> HTTP listener registry could not find context rabbitmq_management_tls
2026-03-02 02:05:14.517833+00:00 [notice] <0.44.0> Application rabbitmq_management exited with reason: stopped
2026-03-02 02:05:14.517965+00:00 [info] <0.977.0> Stopping application 'rabbitmq_prometheus'
2026-03-02 02:05:14.519624+00:00 [warning] <0.653.0> HTTP listener registry could not find context rabbitmq_prometheus_tls
2026-03-02 02:05:14.521323+00:00 [notice] <0.44.0> Application rabbitmq_prometheus exited with reason: stopped
2026-03-02 02:05:14.521398+00:00 [info] <0.977.0> Stopping application 'rabbitmq_web_dispatch'
2026-03-02 02:05:14.536633+00:00 [notice] <0.44.0> Application rabbitmq_web_dispatch exited with reason: stopped
2026-03-02 02:05:14.536753+00:00 [info] <0.977.0> Stopping application 'cowboy'
2026-03-02 02:05:14.560315+00:00 [notice] <0.44.0> Application cowboy exited with reason: stopped
2026-03-02 02:05:14.560442+00:00 [info] <0.977.0> Stopping application 'cowlib'
2026-03-02 02:05:14.560558+00:00 [notice] <0.44.0> Application cowlib exited with reason: stopped
2026-03-02 02:05:14.560593+00:00 [info] <0.977.0> Stopping application 'rabbitmq_management_agent'
2026-03-02 02:05:14.563007+00:00 [notice] <0.44.0> Application rabbitmq_management_agent exited with reason: stopped
2026-03-02 02:05:14.563093+00:00 [info] <0.977.0> Stopping application 'rabbit'
2026-03-02 02:05:14.564558+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping unregistration.
2026-03-02 02:05:14.564714+00:00 [info] <0.747.0> stopped TCP listener on 10.0.0.23:5673
2026-03-02 02:05:14.565889+00:00 [info] <0.998.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3' because the vhost is stopping
2026-03-02 02:05:20.140147+00:00 [info] <0.508.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' down
2026-03-02 02:05:20.151689+00:00 [info] <0.508.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-5413-2 listeners: the node is already back
2026-03-02 02:05:29.932178+00:00 [info] <0.508.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' down: connection_closed
2026-03-02 02:05:30.452415+00:00 [info] <0.508.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' up
2026-03-02 02:05:31.392940+00:00 [info] <0.508.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' down: connection_closed
2026-03-02 02:05:36.952298+00:00 [info] <0.508.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' up
2026-03-02 02:05:37.556998+00:00 [info] <0.508.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' up
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>     supervisor: {<0.995.0>,rabbit_amqqueue_sup}
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>     errorContext: shutdown_error
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>     reason: killed
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>     offender: [{pid,<0.996.0>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                {id,rabbit_amqqueue},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                {mfargs,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                    {rabbit_prequeue,start_link,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                        [{amqqueue,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             {resource,<<"/">>,queue,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                                 <<"svc_monitor.cn-jenkins-deploy-platform-ansible-os-5413-2.">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             false,false,none,[],<12899.1238.0>,[],[],[],
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             [{vhost,<<"/">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                              {name,<<"ha">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                              {pattern,<<"^(?!amq\\.).*">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                              {'apply-to',<<"all">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                              {definition,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                                  [{<<"ha-mode">>,<<"all">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                                   {<<"ha-sync-batch-size">>,5},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                                   {<<"ha-sync-mode">>,<<"automatic">>}]},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                              {priority,0}],
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             undefined,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             [{<12899.1247.0>,<12899.1238.0>}],
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             [],live,0,[],<<"/">>,
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             #{user => <<"guest">>},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                             rabbit_classic_queue,#{}},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                         slave,<0.994.0>]}},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                {restart_type,intrinsic},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                {shutdown,600000},
2026-03-02 02:15:14.566778+00:00 [error] <0.995.0>                {child_type,worker}]
2026-03-02 02:15:14.567558+00:00 [info] <0.566.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2026-03-02 02:15:14.572702+00:00 [info] <0.566.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2026-03-02 02:15:14.572963+00:00 [info] <0.562.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2026-03-02 02:15:14.577079+00:00 [info] <0.562.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2026-03-02 02:15:14.580939+00:00 [info] <0.499.0> Management plugin: to stop collect_statistics.
2026-03-02 02:15:19.587988+00:00 [notice] <0.44.0> Application rabbit exited with reason: stopped
2026-03-02 02:15:19.588211+00:00 [info] <0.977.0> Stopping application 'amqp_client'
2026-03-02 02:15:19.591818+00:00 [notice] <0.44.0> Application amqp_client exited with reason: stopped
2026-03-02 02:15:19.591966+00:00 [info] <0.977.0> Stopping application 'rabbitmq_prelaunch'
2026-03-02 02:15:19.593876+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: stopped
2026-03-02 02:15:19.594002+00:00 [info] <0.977.0> Stopping application 'rabbit_common'
2026-03-02 02:15:19.594124+00:00 [notice] <0.44.0> Application rabbit_common exited with reason: stopped
2026-03-02 02:15:19.594212+00:00 [info] <0.977.0> Stopping application 'prometheus'
2026-03-02 02:15:19.596007+00:00 [notice] <0.44.0> Application prometheus exited with reason: stopped
2026-03-02 02:15:19.596081+00:00 [info] <0.977.0> Stopping application 'ra'
2026-03-02 02:15:19.602925+00:00 [notice] <0.44.0> Application ra exited with reason: stopped
2026-03-02 02:15:19.603038+00:00 [info] <0.977.0> Stopping application 'accept'
2026-03-02 02:15:19.603194+00:00 [notice] <0.44.0> Application accept exited with reason: stopped
2026-03-02 02:15:19.603329+00:00 [info] <0.977.0> Stopping application 'os_mon'
2026-03-02 02:15:19.605215+00:00 [notice] <0.44.0> Application os_mon exited with reason: stopped
2026-03-02 02:15:19.605355+00:00 [info] <0.977.0> Stopping application 'sysmon_handler'
2026-03-02 02:15:19.608343+00:00 [notice] <0.44.0> Application sysmon_handler exited with reason: stopped
2026-03-02 02:15:19.608503+00:00 [info] <0.977.0> Stopping application 'osiris'
2026-03-02 02:15:19.610795+00:00 [notice] <0.44.0> Application osiris exited with reason: stopped
2026-03-02 02:15:19.610900+00:00 [info] <0.977.0> Stopping application 'mnesia'
2026-03-02 02:15:19.622093+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-03-02 02:15:19.622317+00:00 [info] <0.977.0> Successfully stopped RabbitMQ and its dependencies
2026-03-02 02:15:30.929351+00:00 [info] <0.1985.0> Resetting Rabbit forcefully
2026-03-02 02:15:31.485245+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-03-02 02:15:31.498080+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-03-02 02:15:31.603087+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:31.603299+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:31.614930+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:31.615134+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:31.615190+00:00 [warning] <0.1991.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3-feature_flags`:
2026-03-02 02:15:31.615248+00:00 [warning] <0.1991.0> Feature flags:   - list of previously disabled feature flags now marked as such: [maintenance_mode_status]
2026-03-02 02:15:31.617326+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:31.617512+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:31.631687+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2026-03-02 02:15:31.631917+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:31.637866+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-03-02 02:15:31.652828+00:00 [info] <0.1991.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-5413-2',
2026-03-02 02:15:31.652828+00:00 [info] <0.1991.0>                  'contrail@cn-jenkins-deploy-platform-ansible-os-5413-1'] as disc node
2026-03-02 02:15:31.676670+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:31.676882+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:32.542960+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:32.543196+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:32.543251+00:00 [warning] <0.1991.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3-feature_flags`:
2026-03-02 02:15:32.543299+00:00 [warning] <0.1991.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status]
2026-03-02 02:15:32.545651+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:32.545820+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:32.563148+00:00 [info] <0.1991.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:32.563413+00:00 [info] <0.1991.0> Successfully synced tables from a peer
2026-03-02 02:15:32.569079+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-03-02 02:15:32.569234+00:00 [error] <0.1991.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': {node_not_running,
2026-03-02 02:15:32.569234+00:00 [error] <0.1991.0>                                                                                                                'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'}
2026-03-02 02:15:32.569392+00:00 [info] <0.1991.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:32.569525+00:00 [error] <0.1991.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': {node_not_running,
2026-03-02 02:15:32.569525+00:00 [error] <0.1991.0>                                                                                                                          'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'}
2026-03-02 02:15:32.569624+00:00 [info] <0.1991.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:32.569728+00:00 [error] <0.1991.0> Failed to create a per-user tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': {node_not_running,
2026-03-02 02:15:32.569728+00:00 [error] <0.1991.0>                                                                                                                         'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'}
2026-03-02 02:15:32.569790+00:00 [info] <0.1991.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0> Halting Erlang VM with the following applications:
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     amqp10_common
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     observer_cli
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     stdout_formatter
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     seshat
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     gen_batch_server
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     aten
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     ranch
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     inets
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     systemd
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     enough
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     cuttlefish
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     credentials_obfuscation
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     recon
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     jsx
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     xmerl
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     tools
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     syntax_tools
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     ssl
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     public_key
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     asn1
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     crypto
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     compiler
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     sasl
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     stdlib
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0>     kernel
2026-03-02 02:15:33.146396+00:00 [info] <0.2356.0> 
2026-03-02 02:15:37.966849+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2026-03-02 02:15:40.714179+00:00 [info] <0.222.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3-upgrade-backup"
2026-03-02 02:15:40.718409+00:00 [info] <0.222.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3-upgrade-backup"
2026-03-02 02:15:40.725691+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2026-03-02 02:15:40.726881+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2026-03-02 02:15:40.726932+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2026-03-02 02:15:40.726977+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2026-03-02 02:15:40.726998+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2026-03-02 02:15:40.727023+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2026-03-02 02:15:40.727068+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2026-03-02 02:15:40.727091+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2026-03-02 02:15:40.727109+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2026-03-02 02:15:40.727127+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2026-03-02 02:15:40.727185+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2026-03-02 02:15:40.727208+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2026-03-02 02:15:40.791000+00:00 [info] <0.222.0> ra: starting system quorum_queues
2026-03-02 02:15:40.791110+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:15:40.793381+00:00 [info] <0.313.0> ra system 'quorum_queues' running pre init for 0 registered servers
2026-03-02 02:15:40.794292+00:00 [info] <0.314.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2026-03-02 02:15:40.794476+00:00 [notice] <0.319.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2026-03-02 02:15:40.798295+00:00 [info] <0.222.0> ra: starting system coordination
2026-03-02 02:15:40.798394+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:15:40.799403+00:00 [info] <0.331.0> ra system 'coordination' running pre init for 0 registered servers
2026-03-02 02:15:40.800018+00:00 [info] <0.333.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2026-03-02 02:15:40.800162+00:00 [notice] <0.343.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2026-03-02 02:15:40.804353+00:00 [info] <0.222.0> 
2026-03-02 02:15:40.804353+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2026-03-02 02:15:40.804353+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2026-03-02 02:15:40.804353+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0> 
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3_upgrade.log
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>                 : <stdout>
2026-03-02 02:15:40.805723+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3
2026-03-02 02:15:41.166198+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true
2026-03-02 02:15:41.168086+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true
2026-03-02 02:15:41.390947+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2026-03-02 02:15:41.391050+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2026-03-02 02:15:41.391864+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2026-03-02 02:15:41.392005+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2026-03-02 02:15:41.392469+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2026-03-02 02:15:41.396760+00:00 [info] <0.418.0> Memory high watermark set to 12637 MiB (13251084288 bytes) of 15796 MiB (16563855360 bytes) total
2026-03-02 02:15:41.410574+00:00 [info] <0.420.0> Enabling free disk space monitoring
2026-03-02 02:15:41.410662+00:00 [info] <0.420.0> Disk free limit set to 50MB
2026-03-02 02:15:41.413873+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2026-03-02 02:15:41.414028+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2026-03-02 02:15:41.414349+00:00 [info] <0.425.0> Limiting to approx 927 file handles (832 sockets)
2026-03-02 02:15:41.414445+00:00 [info] <0.426.0> FHC read buffering: OFF
2026-03-02 02:15:41.414487+00:00 [info] <0.426.0> FHC write buffering: ON
2026-03-02 02:15:41.414813+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2026-03-02 02:15:41.414905+00:00 [info] <0.349.0> Will use 4 processes for default worker pool
2026-03-02 02:15:41.414969+00:00 [info] <0.349.0> Starting worker pool 'worker_pool' with 4 processes in it
2026-03-02 02:15:41.415350+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2026-03-02 02:15:41.417822+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:41.421324+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:15:41.421884+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:41.422040+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:15:41.422114+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3-feature_flags`:
2026-03-02 02:15:41.422152+00:00 [warning] <0.222.0> Feature flags:   - list of previously disabled feature flags now marked as such: [empty_basic_get_metric]
2026-03-02 02:15:41.424611+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:41.424715+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:15:41.452066+00:00 [info] <0.222.0> upgrades: Mnesia backup removed
2026-03-02 02:15:41.452142+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2026-03-02 02:15:41.452321+00:00 [info] <0.222.0> Successfully synced tables from a peer
2026-03-02 02:15:41.452353+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2026-03-02 02:15:41.452470+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2026-03-02 02:15:41.452614+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2026-03-02 02:15:41.452746+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2026-03-02 02:15:41.452805+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2026-03-02 02:15:41.452848+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2026-03-02 02:15:41.452982+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2026-03-02 02:15:41.453050+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2026-03-02 02:15:41.453110+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2026-03-02 02:15:41.453150+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2026-03-02 02:15:41.453184+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2026-03-02 02:15:41.453221+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2026-03-02 02:15:41.453250+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2026-03-02 02:15:41.453284+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2026-03-02 02:15:41.453313+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2026-03-02 02:15:41.453350+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2026-03-02 02:15:41.453384+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2026-03-02 02:15:41.453415+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2026-03-02 02:15:41.453439+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2026-03-02 02:15:41.453483+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2026-03-02 02:15:41.453522+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2026-03-02 02:15:41.453554+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2026-03-02 02:15:41.453586+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2026-03-02 02:15:41.453605+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2026-03-02 02:15:41.453752+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2026-03-02 02:15:41.454491+00:00 [info] <0.450.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2026-03-02 02:15:41.454620+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2026-03-02 02:15:41.457959+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2026-03-02 02:15:41.459049+00:00 [info] <0.454.0> Starting rabbit_node_monitor
2026-03-02 02:15:41.459208+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2026-03-02 02:15:41.459626+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2026-03-02 02:15:41.459767+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2026-03-02 02:15:41.459885+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2026-03-02 02:15:41.459965+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2026-03-02 02:15:41.466463+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2026-03-02 02:15:41.466587+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2026-03-02 02:15:41.466732+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2026-03-02 02:15:41.466763+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2026-03-02 02:15:41.467193+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2026-03-02 02:15:41.480190+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2026-03-02 02:15:41.489112+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:41.497288+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:41.497537+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2026-03-02 02:15:41.497606+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2026-03-02 02:15:41.506110+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:41.513078+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:41.519053+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-5413-3'
2026-03-02 02:15:41.519337+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2026-03-02 02:15:41.519426+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2026-03-02 02:15:41.519540+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2026-03-02 02:15:41.519621+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2026-03-02 02:15:41.519828+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2026-03-02 02:15:41.520108+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2026-03-02 02:15:41.520165+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2026-03-02 02:15:41.520212+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2026-03-02 02:15:41.520250+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2026-03-02 02:15:41.520362+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2026-03-02 02:15:41.520434+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2026-03-02 02:15:41.520495+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2026-03-02 02:15:41.520534+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2026-03-02 02:15:41.520534+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2026-03-02 02:15:41.520600+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2026-03-02 02:15:41.522573+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2026-03-02 02:15:41.523925+00:00 [info] <0.512.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-5413-3/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2026-03-02 02:15:41.524770+00:00 [info] <0.512.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2026-03-02 02:15:41.528643+00:00 [info] <0.512.0> Starting message stores for vhost '/'
2026-03-02 02:15:41.529108+00:00 [info] <0.517.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2026-03-02 02:15:41.530094+00:00 [info] <0.512.0> Started message store of type transient for vhost '/'
2026-03-02 02:15:41.530292+00:00 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2026-03-02 02:15:41.531065+00:00 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2026-03-02 02:15:41.532171+00:00 [info] <0.512.0> Started message store of type persistent for vhost '/'
2026-03-02 02:15:41.532290+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_classic_queue took 7ms
2026-03-02 02:15:41.532338+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2026-03-02 02:15:41.532375+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2026-03-02 02:15:41.535940+00:00 [info] <0.512.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.541.0>
2026-03-02 02:15:41.536385+00:00 [info] <0.512.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5413-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.545.0>
2026-03-02 02:15:41.536764+00:00 [info] <0.512.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5413-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.549.0>
2026-03-02 02:15:41.537058+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5413-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.553.0>
2026-03-02 02:15:41.537408+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5413-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.557.0>
2026-03-02 02:15:41.538033+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5413-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.561.0>
2026-03-02 02:15:41.538460+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5413-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.565.0>
2026-03-02 02:15:41.539327+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.569.0>
2026-03-02 02:15:41.539594+00:00 [info] <0.512.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5413-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.573.0>
2026-03-02 02:15:41.539901+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5413-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.577.0>
2026-03-02 02:15:41.540798+00:00 [info] <0.512.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5413-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.585.0>
2026-03-02 02:15:41.541221+00:00 [info] <0.512.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-5413-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.589.0>
2026-03-02 02:15:41.541561+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5413-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.593.0>
2026-03-02 02:15:41.542258+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5413-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.597.0>
2026-03-02 02:15:41.543216+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5413-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.602.0>
2026-03-02 02:15:41.543829+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-5413-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.612.0>
2026-03-02 02:15:41.544533+00:00 [info] <0.512.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-5413-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.617.0>
2026-03-02 02:15:41.545080+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5413-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.621.0>
2026-03-02 02:15:41.545595+00:00 [info] <0.512.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.626.0>
2026-03-02 02:15:41.546799+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5413-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.635.0>
2026-03-02 02:15:41.547687+00:00 [info] <0.512.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5413-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.642.0>
2026-03-02 02:15:41.548208+00:00 [info] <0.512.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5413-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.648.0>
2026-03-02 02:15:41.548867+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-5413-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.653.0>
2026-03-02 02:15:41.549308+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5413-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.658.0>
2026-03-02 02:15:41.549578+00:00 [info] <0.512.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-5413-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.663.0>
2026-03-02 02:15:41.549755+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-5413-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.667.0>
2026-03-02 02:15:41.549990+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-5413-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.671.0>
2026-03-02 02:15:41.550592+00:00 [info] <0.512.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-5413-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.675.0>
2026-03-02 02:15:41.550945+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-5413-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.679.0>
2026-03-02 02:15:41.551173+00:00 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-5413-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-5413-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.683.0>
2026-03-02 02:15:41.551503+00:00 [info] <0.512.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-5413-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-3': <0.688.0>
2026-03-02 02:15:41.551715+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2026-03-02 02:15:41.551810+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2026-03-02 02:15:41.551852+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2026-03-02 02:15:41.551893+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2026-03-02 02:15:41.552013+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2026-03-02 02:15:41.552105+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2026-03-02 02:15:41.552142+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2026-03-02 02:15:41.552190+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2026-03-02 02:15:41.552237+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2026-03-02 02:15:41.552275+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2026-03-02 02:15:41.552325+00:00 [info] <0.349.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2026-03-02 02:15:41.552773+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2026-03-02 02:15:41.552844+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2026-03-02 02:15:41.552925+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2026-03-02 02:15:41.552968+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2026-03-02 02:15:41.553029+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-1' up
2026-03-02 02:15:41.557785+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2026-03-02 02:15:41.558265+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2026-03-02 02:15:41.558313+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2026-03-02 02:15:41.558525+00:00 [info] <0.222.0> Importing concurrently 1 users...
2026-03-02 02:15:41.582618+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2026-03-02 02:15:41.603555+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2026-03-02 02:15:41.608973+00:00 [info] <0.697.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2026-03-02 02:15:41.609188+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2026-03-02 02:15:41.626826+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-5413-2' up
2026-03-02 02:15:41.680641+00:00 [info] <0.815.0> Resetting node maintenance status
2026-03-02 02:15:41.730859+00:00 [info] <0.884.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2026-03-02 02:15:41.731061+00:00 [info] <0.912.0> Statistics database started.
2026-03-02 02:15:41.731168+00:00 [info] <0.911.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2026-03-02 02:15:41.759070+00:00 [info] <0.932.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2026-03-02 02:15:41.759234+00:00 [info] <0.815.0> Ready to start client connection listeners
2026-03-02 02:15:41.760580+00:00 [info] <0.976.0> started TCP listener on 10.0.0.23:5673
2026-03-02 02:15:41.873077+00:00 [info] <0.815.0> Server startup complete; 4 plugins started.
2026-03-02 02:15:41.873077+00:00 [info] <0.815.0>  * rabbitmq_prometheus
2026-03-02 02:15:41.873077+00:00 [info] <0.815.0>  * rabbitmq_management
2026-03-02 02:15:41.873077+00:00 [info] <0.815.0>  * rabbitmq_web_dispatch
2026-03-02 02:15:41.873077+00:00 [info] <0.815.0>  * rabbitmq_management_agent