2025-09-01 01:55:37.497954+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2025-09-01 01:55:37.682180+00:00 [info] <0.222.0> ra: starting system quorum_queues
2025-09-01 01:55:37.682303+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:55:37.731708+00:00 [info] <0.259.0> ra system 'quorum_queues' running pre init for 0 registered servers
2025-09-01 01:55:37.737565+00:00 [info] <0.260.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2025-09-01 01:55:37.745564+00:00 [notice] <0.265.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2025-09-01 01:55:37.755800+00:00 [info] <0.222.0> ra: starting system coordination
2025-09-01 01:55:37.755870+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:55:37.756775+00:00 [info] <0.272.0> ra system 'coordination' running pre init for 0 registered servers
2025-09-01 01:55:37.757383+00:00 [info] <0.273.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2025-09-01 01:55:37.757557+00:00 [notice] <0.278.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2025-09-01 01:55:37.761987+00:00 [info] <0.222.0> 
2025-09-01 01:55:37.761987+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2025-09-01 01:55:37.761987+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2025-09-01 01:55:37.761987+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0> 
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2_upgrade.log
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>                 : <stdout>
2025-09-01 01:55:37.763123+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:55:37.947697+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:37.947784+00:00 [info] <0.222.0> Feature flags:   [ ] classic_mirrored_queue_version
2025-09-01 01:55:37.947812+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2025-09-01 01:55:37.947846+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2025-09-01 01:55:37.947894+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2025-09-01 01:55:37.947914+00:00 [info] <0.222.0> Feature flags:   [ ] maintenance_mode_status
2025-09-01 01:55:37.947933+00:00 [info] <0.222.0> Feature flags:   [ ] quorum_queue
2025-09-01 01:55:37.948030+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2025-09-01 01:55:37.948052+00:00 [info] <0.222.0> Feature flags:   [ ] user_limits
2025-09-01 01:55:37.948069+00:00 [info] <0.222.0> Feature flags:   [ ] virtual_host_metadata
2025-09-01 01:55:37.948099+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:40.202615+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2025-09-01 01:55:40.202711+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2025-09-01 01:55:40.203073+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2025-09-01 01:55:40.203195+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-09-01 01:55:40.203659+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2025-09-01 01:55:40.214609+00:00 [info] <0.302.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total
2025-09-01 01:55:40.227209+00:00 [info] <0.304.0> Enabling free disk space monitoring
2025-09-01 01:55:40.227340+00:00 [info] <0.304.0> Disk free limit set to 50MB
2025-09-01 01:55:40.230428+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2025-09-01 01:55:40.230564+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2025-09-01 01:55:40.230744+00:00 [info] <0.309.0> Limiting to approx 1048479 file handles (943629 sockets)
2025-09-01 01:55:40.230832+00:00 [info] <0.310.0> FHC read buffering: OFF
2025-09-01 01:55:40.230868+00:00 [info] <0.310.0> FHC write buffering: ON
2025-09-01 01:55:40.233747+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2025-09-01 01:55:40.233836+00:00 [info] <0.280.0> Will use 4 processes for default worker pool
2025-09-01 01:55:40.233879+00:00 [info] <0.280.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-09-01 01:55:40.234212+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2025-09-01 01:55:40.235860+00:00 [info] <0.222.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2 is empty. Assuming we need to join an existing cluster or initialise from scratch...
2025-09-01 01:55:40.235925+00:00 [info] <0.222.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config
2025-09-01 01:55:40.235954+00:00 [info] <0.222.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config
2025-09-01 01:55:45.168433+00:00 [info] <0.222.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-3995-1, contrail@cn-jenkins-deploy-platform-ansible-os-3995-2, contrail@cn-jenkins-deploy-platform-ansible-os-3995-3
2025-09-01 01:55:45.168656+00:00 [info] <0.222.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-3995-1, contrail@cn-jenkins-deploy-platform-ansible-os-3995-3
2025-09-01 01:55:45.169467+00:00 [warning] <0.222.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-3995-1: {error,
2025-09-01 01:55:45.169467+00:00 [warning] <0.222.0>                                                                                          tables_not_present}
2025-09-01 01:55:45.171857+00:00 [info] <0.222.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-3' selected for auto-clustering
2025-09-01 01:55:45.190782+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:55:45.190979+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:55:45.395774+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:55:45.395969+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:55:45.396022+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-feature_flags`:
2025-09-01 01:55:45.396080+00:00 [warning] <0.222.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status,
2025-09-01 01:55:45.396080+00:00 [warning] <0.222.0>                                                                                  quorum_queue,
2025-09-01 01:55:45.396080+00:00 [warning] <0.222.0>                                                                                  user_limits,
2025-09-01 01:55:45.396080+00:00 [warning] <0.222.0>                                                                                  virtual_host_metadata]
2025-09-01 01:55:45.397906+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:45.397984+00:00 [info] <0.222.0> Feature flags:   [ ] classic_mirrored_queue_version
2025-09-01 01:55:45.398030+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2025-09-01 01:55:45.398064+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2025-09-01 01:55:45.398122+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2025-09-01 01:55:45.398146+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:55:45.398174+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:55:45.398201+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2025-09-01 01:55:45.398274+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:55:45.398293+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:55:45.398323+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:45.409733+00:00 [info] <0.222.0> Feature flag `classic_mirrored_queue_version`: mark as enabled=true
2025-09-01 01:55:45.412012+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:45.412098+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:55:45.412143+00:00 [info] <0.222.0> Feature flags:   [ ] drop_unroutable_metric
2025-09-01 01:55:45.412244+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2025-09-01 01:55:45.412279+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2025-09-01 01:55:45.412358+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:55:45.412415+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:55:45.412453+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2025-09-01 01:55:45.412492+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:55:45.412523+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:55:45.412569+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:45.423631+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true
2025-09-01 01:55:45.425626+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:45.425689+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:55:45.425716+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:55:45.425748+00:00 [info] <0.222.0> Feature flags:   [ ] empty_basic_get_metric
2025-09-01 01:55:45.425769+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2025-09-01 01:55:45.425790+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:55:45.425816+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:55:45.425846+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2025-09-01 01:55:45.425865+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:55:45.425935+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:55:45.425974+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:45.436120+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true
2025-09-01 01:55:45.438713+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:45.438800+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:55:45.438843+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:55:45.438885+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2025-09-01 01:55:45.438929+00:00 [info] <0.222.0> Feature flags:   [ ] implicit_default_bindings
2025-09-01 01:55:45.438950+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:55:45.438970+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:55:45.439022+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2025-09-01 01:55:45.439048+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:55:45.439069+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:55:45.439111+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:45.447676+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2025-09-01 01:55:45.447824+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:55:45.447872+00:00 [info] <0.222.0> Feature flag `implicit_default_bindings`: mark as enabled=true
2025-09-01 01:55:45.450019+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:45.450083+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:55:45.450117+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:55:45.450146+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2025-09-01 01:55:45.450208+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2025-09-01 01:55:45.450237+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:55:45.450267+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:55:45.450294+00:00 [info] <0.222.0> Feature flags:   [ ] stream_queue
2025-09-01 01:55:45.450533+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:55:45.450564+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:55:45.450594+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:45.459974+00:00 [info] <0.222.0> Feature flag `stream_queue`: mark as enabled=true
2025-09-01 01:55:45.462348+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:55:45.462498+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:55:45.462534+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:55:45.462555+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2025-09-01 01:55:45.462585+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2025-09-01 01:55:45.462619+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:55:45.462651+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:55:45.462671+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2025-09-01 01:55:45.462717+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:55:45.462755+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:55:45.462859+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:55:45.479106+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:55:45.479259+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:55:45.496491+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:55:45.496732+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:55:45.503249+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.510375+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.515782+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.516533+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2025-09-01 01:55:45.516583+00:00 [info] <0.222.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config
2025-09-01 01:55:45.517201+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2025-09-01 01:55:45.517339+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2025-09-01 01:55:45.517533+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2025-09-01 01:55:45.517565+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2025-09-01 01:55:45.517585+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2025-09-01 01:55:45.517802+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2025-09-01 01:55:45.517889+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-09-01 01:55:45.518001+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-09-01 01:55:45.518078+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-09-01 01:55:45.518133+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-09-01 01:55:45.518179+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-09-01 01:55:45.518217+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-09-01 01:55:45.518261+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-09-01 01:55:45.518306+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-09-01 01:55:45.518362+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-09-01 01:55:45.518420+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-09-01 01:55:45.518538+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-09-01 01:55:45.518596+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-09-01 01:55:45.518665+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-09-01 01:55:45.518739+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-09-01 01:55:45.518794+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-09-01 01:55:45.518834+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2025-09-01 01:55:45.518855+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-09-01 01:55:45.519018+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-09-01 01:55:45.519920+00:00 [info] <0.502.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-09-01 01:55:45.520103+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2025-09-01 01:55:45.523273+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-09-01 01:55:45.523894+00:00 [info] <0.506.0> Starting rabbit_node_monitor
2025-09-01 01:55:45.523989+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2025-09-01 01:55:45.524441+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-09-01 01:55:45.524723+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2025-09-01 01:55:45.524792+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2025-09-01 01:55:45.524827+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2025-09-01 01:55:45.531651+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2025-09-01 01:55:45.531764+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2025-09-01 01:55:45.531887+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2025-09-01 01:55:45.531931+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2025-09-01 01:55:45.532354+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2025-09-01 01:55:45.541209+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2025-09-01 01:55:45.546617+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.552399+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.552633+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2025-09-01 01:55:45.552698+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2025-09-01 01:55:45.553298+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.553869+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.555154+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:55:45.555493+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-09-01 01:55:45.555586+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2025-09-01 01:55:45.555695+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-09-01 01:55:45.555801+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-09-01 01:55:45.556009+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2025-09-01 01:55:45.556306+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2025-09-01 01:55:45.556362+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-09-01 01:55:45.556402+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2025-09-01 01:55:45.556468+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2025-09-01 01:55:45.556582+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-09-01 01:55:45.556703+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-09-01 01:55:45.556791+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-09-01 01:55:45.556835+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2025-09-01 01:55:45.556835+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-09-01 01:55:45.556909+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2025-09-01 01:55:45.558141+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2025-09-01 01:55:45.559732+00:00 [info] <0.555.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-09-01 01:55:45.560862+00:00 [info] <0.555.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2025-09-01 01:55:45.565133+00:00 [info] <0.555.0> Starting message stores for vhost '/'
2025-09-01 01:55:45.565425+00:00 [info] <0.560.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-09-01 01:55:45.566613+00:00 [info] <0.555.0> Started message store of type transient for vhost '/'
2025-09-01 01:55:45.566785+00:00 [info] <0.564.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-09-01 01:55:45.567335+00:00 [warning] <0.564.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2025-09-01 01:55:45.568028+00:00 [info] <0.555.0> Started message store of type persistent for vhost '/'
2025-09-01 01:55:45.568141+00:00 [info] <0.555.0> Recovering 0 queues of type rabbit_classic_queue took 6ms
2025-09-01 01:55:45.568201+00:00 [info] <0.555.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2025-09-01 01:55:45.568245+00:00 [info] <0.555.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2025-09-01 01:55:45.569614+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2025-09-01 01:55:45.569678+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2025-09-01 01:55:45.569704+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-09-01 01:55:45.569731+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-09-01 01:55:45.569865+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2025-09-01 01:55:45.570024+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2025-09-01 01:55:45.570069+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2025-09-01 01:55:45.570118+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2025-09-01 01:55:45.570142+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2025-09-01 01:55:45.570173+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2025-09-01 01:55:45.570230+00:00 [info] <0.280.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2025-09-01 01:55:45.570489+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2025-09-01 01:55:45.570568+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2025-09-01 01:55:45.570738+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2025-09-01 01:55:45.570785+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2025-09-01 01:55:45.570992+00:00 [info] <0.506.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-3' up
2025-09-01 01:55:45.571314+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2025-09-01 01:55:45.571692+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2025-09-01 01:55:45.571752+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2025-09-01 01:55:45.571847+00:00 [info] <0.222.0> Importing concurrently 1 users...
2025-09-01 01:55:45.576539+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2025-09-01 01:55:45.580877+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2025-09-01 01:55:45.584322+00:00 [info] <0.588.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2025-09-01 01:55:45.584498+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2025-09-01 01:55:45.588357+00:00 [info] <0.599.0> Resetting node maintenance status
2025-09-01 01:55:45.603409+00:00 [info] <0.658.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-09-01 01:55:45.603612+00:00 [info] <0.686.0> Statistics database started.
2025-09-01 01:55:45.603724+00:00 [info] <0.685.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-09-01 01:55:45.613211+00:00 [info] <0.700.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2025-09-01 01:55:45.613404+00:00 [info] <0.599.0> Ready to start client connection listeners
2025-09-01 01:55:45.615155+00:00 [info] <0.744.0> started TCP listener on 10.0.0.38:5673
2025-09-01 01:55:45.704138+00:00 [info] <0.599.0> Server startup complete; 4 plugins started.
2025-09-01 01:55:45.704138+00:00 [info] <0.599.0>  * rabbitmq_prometheus
2025-09-01 01:55:45.704138+00:00 [info] <0.599.0>  * rabbitmq_management
2025-09-01 01:55:45.704138+00:00 [info] <0.599.0>  * rabbitmq_web_dispatch
2025-09-01 01:55:45.704138+00:00 [info] <0.599.0>  * rabbitmq_management_agent
2025-09-01 01:55:50.508669+00:00 [info] <0.506.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-1' up
2025-09-01 01:56:32.593247+00:00 [info] <0.506.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-3' down
2025-09-01 01:56:32.607028+00:00 [info] <0.506.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-3995-3 listeners: the node is already back
2025-09-01 01:56:33.877074+00:00 [info] <0.1217.0> RabbitMQ is asked to stop...
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0> Stopping RabbitMQ applications and their dependencies in the following order:
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbitmq_management
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbitmq_prometheus
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbitmq_web_dispatch
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     cowboy
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     cowlib
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbitmq_management_agent
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbit
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     amqp_client
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbitmq_prelaunch
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     rabbit_common
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     prometheus
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     ra
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     accept
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     os_mon
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     sysmon_handler
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     osiris
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0>     mnesia
2025-09-01 01:56:33.965909+00:00 [info] <0.1217.0> 
2025-09-01 01:56:33.966085+00:00 [info] <0.1217.0> Stopping application 'rabbitmq_management'
2025-09-01 01:56:33.985724+00:00 [warning] <0.650.0> HTTP listener registry could not find context rabbitmq_management_tls
2025-09-01 01:56:33.988696+00:00 [notice] <0.44.0> Application rabbitmq_management exited with reason: stopped
2025-09-01 01:56:33.988844+00:00 [info] <0.1217.0> Stopping application 'rabbitmq_prometheus'
2025-09-01 01:56:33.995874+00:00 [warning] <0.650.0> HTTP listener registry could not find context rabbitmq_prometheus_tls
2025-09-01 01:56:33.997823+00:00 [notice] <0.44.0> Application rabbitmq_prometheus exited with reason: stopped
2025-09-01 01:56:33.997912+00:00 [info] <0.1217.0> Stopping application 'rabbitmq_web_dispatch'
2025-09-01 01:56:34.007571+00:00 [notice] <0.44.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-09-01 01:56:34.007807+00:00 [info] <0.1217.0> Stopping application 'cowboy'
2025-09-01 01:56:34.009770+00:00 [notice] <0.44.0> Application cowboy exited with reason: stopped
2025-09-01 01:56:34.009854+00:00 [info] <0.1217.0> Stopping application 'cowlib'
2025-09-01 01:56:34.013185+00:00 [notice] <0.44.0> Application cowlib exited with reason: stopped
2025-09-01 01:56:34.013397+00:00 [info] <0.1217.0> Stopping application 'rabbitmq_management_agent'
2025-09-01 01:56:34.016130+00:00 [notice] <0.44.0> Application rabbitmq_management_agent exited with reason: stopped
2025-09-01 01:56:34.016231+00:00 [info] <0.1217.0> Stopping application 'rabbit'
2025-09-01 01:56:34.024310+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping unregistration.
2025-09-01 01:56:34.024460+00:00 [info] <0.744.0> stopped TCP listener on 10.0.0.38:5673
2025-09-01 01:56:34.025298+00:00 [info] <0.1218.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2' because the vhost is stopping
2025-09-01 01:56:34.025377+00:00 [info] <0.564.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-09-01 01:56:34.037793+00:00 [info] <0.564.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-09-01 01:56:34.037992+00:00 [info] <0.560.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-09-01 01:56:34.042683+00:00 [info] <0.560.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-09-01 01:56:34.043580+00:00 [info] <0.497.0> Management plugin: to stop collect_statistics.
2025-09-01 01:56:39.046745+00:00 [notice] <0.44.0> Application rabbit exited with reason: stopped
2025-09-01 01:56:39.046903+00:00 [info] <0.1217.0> Stopping application 'amqp_client'
2025-09-01 01:56:39.049614+00:00 [notice] <0.44.0> Application amqp_client exited with reason: stopped
2025-09-01 01:56:39.049736+00:00 [info] <0.1217.0> Stopping application 'rabbitmq_prelaunch'
2025-09-01 01:56:39.051468+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: stopped
2025-09-01 01:56:39.051549+00:00 [info] <0.1217.0> Stopping application 'rabbit_common'
2025-09-01 01:56:39.051596+00:00 [notice] <0.44.0> Application rabbit_common exited with reason: stopped
2025-09-01 01:56:39.051645+00:00 [info] <0.1217.0> Stopping application 'prometheus'
2025-09-01 01:56:39.053648+00:00 [notice] <0.44.0> Application prometheus exited with reason: stopped
2025-09-01 01:56:39.053739+00:00 [info] <0.1217.0> Stopping application 'ra'
2025-09-01 01:56:39.058120+00:00 [notice] <0.44.0> Application ra exited with reason: stopped
2025-09-01 01:56:39.058206+00:00 [info] <0.1217.0> Stopping application 'accept'
2025-09-01 01:56:39.058244+00:00 [notice] <0.44.0> Application accept exited with reason: stopped
2025-09-01 01:56:39.058272+00:00 [info] <0.1217.0> Stopping application 'os_mon'
2025-09-01 01:56:39.060383+00:00 [notice] <0.44.0> Application os_mon exited with reason: stopped
2025-09-01 01:56:39.060460+00:00 [info] <0.1217.0> Stopping application 'sysmon_handler'
2025-09-01 01:56:39.062537+00:00 [notice] <0.44.0> Application sysmon_handler exited with reason: stopped
2025-09-01 01:56:39.062620+00:00 [info] <0.1217.0> Stopping application 'osiris'
2025-09-01 01:56:39.064099+00:00 [notice] <0.44.0> Application osiris exited with reason: stopped
2025-09-01 01:56:39.064163+00:00 [info] <0.1217.0> Stopping application 'mnesia'
2025-09-01 01:56:39.067885+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:56:39.067965+00:00 [info] <0.1217.0> Successfully stopped RabbitMQ and its dependencies
2025-09-01 01:56:49.651071+00:00 [info] <0.1250.0> Resetting Rabbit forcefully
2025-09-01 01:56:50.157953+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:56:50.163698+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:56:50.259651+00:00 [info] <0.1256.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:50.259899+00:00 [info] <0.1256.0> Successfully synced tables from a peer
2025-09-01 01:56:50.270430+00:00 [info] <0.1256.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:50.270675+00:00 [info] <0.1256.0> Successfully synced tables from a peer
2025-09-01 01:56:50.270731+00:00 [warning] <0.1256.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-feature_flags`:
2025-09-01 01:56:50.270778+00:00 [warning] <0.1256.0> Feature flags:   - list of previously disabled feature flags now marked as such: [maintenance_mode_status]
2025-09-01 01:56:50.272318+00:00 [info] <0.1256.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:50.272535+00:00 [info] <0.1256.0> Successfully synced tables from a peer
2025-09-01 01:56:50.283388+00:00 [info] <0.1256.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2025-09-01 01:56:50.283586+00:00 [info] <0.1256.0> Successfully synced tables from a peer
2025-09-01 01:56:50.290021+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:56:50.301459+00:00 [info] <0.1256.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-3995-3',
2025-09-01 01:56:50.301459+00:00 [info] <0.1256.0>                  'contrail@cn-jenkins-deploy-platform-ansible-os-3995-1'] as disc node
2025-09-01 01:56:50.327883+00:00 [info] <0.1256.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:50.328039+00:00 [info] <0.1256.0> Successfully synced tables from a peer
2025-09-01 01:56:50.487324+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0> Halting Erlang VM with the following applications:
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     amqp10_common
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     observer_cli
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     stdout_formatter
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     seshat
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     gen_batch_server
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     aten
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     ranch
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     inets
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     systemd
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     enough
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     cuttlefish
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     credentials_obfuscation
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     recon
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     jsx
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     xmerl
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     tools
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     syntax_tools
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     ssl
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     public_key
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     asn1
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     crypto
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     compiler
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     sasl
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     stdlib
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0>     kernel
2025-09-01 01:56:51.032921+00:00 [info] <0.1541.0> 
2025-09-01 01:56:55.376229+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2025-09-01 01:56:55.846684+00:00 [info] <0.222.0> ra: starting system quorum_queues
2025-09-01 01:56:55.846783+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:56:55.875850+00:00 [info] <0.302.0> ra system 'quorum_queues' running pre init for 0 registered servers
2025-09-01 01:56:55.884641+00:00 [info] <0.303.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2025-09-01 01:56:55.900056+00:00 [notice] <0.328.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2025-09-01 01:56:55.910194+00:00 [info] <0.222.0> ra: starting system coordination
2025-09-01 01:56:55.910269+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:56:55.911244+00:00 [info] <0.342.0> ra system 'coordination' running pre init for 0 registered servers
2025-09-01 01:56:55.911860+00:00 [info] <0.345.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2025-09-01 01:56:55.912032+00:00 [notice] <0.350.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2025-09-01 01:56:55.915726+00:00 [info] <0.222.0> 
2025-09-01 01:56:55.915726+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2025-09-01 01:56:55.915726+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2025-09-01 01:56:55.915726+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0> 
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2_upgrade.log
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>                 : <stdout>
2025-09-01 01:56:55.916932+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:56:56.193863+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:56:56.193950+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:56:56.193978+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:56:56.194047+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2025-09-01 01:56:56.194070+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2025-09-01 01:56:56.194091+00:00 [info] <0.222.0> Feature flags:   [ ] maintenance_mode_status
2025-09-01 01:56:56.194110+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:56:56.194279+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2025-09-01 01:56:56.194303+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:56:56.194321+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:56:56.194350+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:56:58.378161+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2025-09-01 01:56:58.378274+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2025-09-01 01:56:58.378654+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2025-09-01 01:56:58.378778+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-09-01 01:56:58.379349+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2025-09-01 01:56:58.383491+00:00 [info] <0.421.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total
2025-09-01 01:56:58.387255+00:00 [info] <0.423.0> Enabling free disk space monitoring
2025-09-01 01:56:58.387311+00:00 [info] <0.423.0> Disk free limit set to 50MB
2025-09-01 01:56:58.390270+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2025-09-01 01:56:58.390379+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2025-09-01 01:56:58.390606+00:00 [info] <0.428.0> Limiting to approx 1048479 file handles (943629 sockets)
2025-09-01 01:56:58.390724+00:00 [info] <0.429.0> FHC read buffering: OFF
2025-09-01 01:56:58.390762+00:00 [info] <0.429.0> FHC write buffering: ON
2025-09-01 01:56:58.391069+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2025-09-01 01:56:58.391128+00:00 [info] <0.358.0> Will use 4 processes for default worker pool
2025-09-01 01:56:58.391181+00:00 [info] <0.358.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-09-01 01:56:58.391512+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2025-09-01 01:56:58.394110+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:58.398424+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:56:58.399037+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:58.399138+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:56:58.399178+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-feature_flags`:
2025-09-01 01:56:58.399230+00:00 [warning] <0.222.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status]
2025-09-01 01:56:58.401370+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:56:58.401429+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:56:58.401474+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:56:58.401504+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2025-09-01 01:56:58.401556+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2025-09-01 01:56:58.401595+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:56:58.401616+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:56:58.401662+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2025-09-01 01:56:58.401682+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:56:58.401701+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:56:58.401721+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:56:58.413163+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:58.413381+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:56:58.431278+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:56:58.431502+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:56:58.431540+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2025-09-01 01:56:58.431662+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2025-09-01 01:56:58.431851+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2025-09-01 01:56:58.431993+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2025-09-01 01:56:58.432021+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2025-09-01 01:56:58.432041+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2025-09-01 01:56:58.432238+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2025-09-01 01:56:58.432339+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-09-01 01:56:58.432410+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-09-01 01:56:58.432491+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-09-01 01:56:58.432549+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-09-01 01:56:58.432610+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-09-01 01:56:58.432724+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-09-01 01:56:58.432818+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-09-01 01:56:58.432861+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-09-01 01:56:58.432897+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-09-01 01:56:58.432940+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-09-01 01:56:58.433018+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-09-01 01:56:58.433137+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-09-01 01:56:58.433224+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-09-01 01:56:58.433323+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-09-01 01:56:58.433478+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-09-01 01:56:58.433567+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2025-09-01 01:56:58.433593+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-09-01 01:56:58.433755+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-09-01 01:56:58.434740+00:00 [info] <0.454.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-09-01 01:56:58.434863+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2025-09-01 01:56:58.438318+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-09-01 01:56:58.439344+00:00 [info] <0.458.0> Starting rabbit_node_monitor
2025-09-01 01:56:58.439488+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2025-09-01 01:56:58.439942+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-09-01 01:56:58.440171+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2025-09-01 01:56:58.440286+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2025-09-01 01:56:58.440330+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2025-09-01 01:56:58.449135+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2025-09-01 01:56:58.449291+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2025-09-01 01:56:58.449516+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2025-09-01 01:56:58.449559+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2025-09-01 01:56:58.450035+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2025-09-01 01:56:58.460973+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2025-09-01 01:56:58.462143+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:56:58.462828+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:56:58.463108+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2025-09-01 01:56:58.463212+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2025-09-01 01:56:58.464071+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:56:58.464715+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:56:58.465422+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:56:58.465701+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-09-01 01:56:58.465786+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2025-09-01 01:56:58.465895+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-09-01 01:56:58.466007+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-09-01 01:56:58.466195+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2025-09-01 01:56:58.466531+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2025-09-01 01:56:58.466599+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-09-01 01:56:58.466669+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2025-09-01 01:56:58.466732+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2025-09-01 01:56:58.466910+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-09-01 01:56:58.466974+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-09-01 01:56:58.467050+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-09-01 01:56:58.467083+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2025-09-01 01:56:58.467083+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-09-01 01:56:58.467120+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2025-09-01 01:56:58.468683+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2025-09-01 01:56:58.469987+00:00 [info] <0.501.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-09-01 01:56:58.471010+00:00 [info] <0.501.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2025-09-01 01:56:58.476141+00:00 [info] <0.501.0> Starting message stores for vhost '/'
2025-09-01 01:56:58.476560+00:00 [info] <0.506.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-09-01 01:56:58.478016+00:00 [info] <0.501.0> Started message store of type transient for vhost '/'
2025-09-01 01:56:58.478247+00:00 [info] <0.510.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-09-01 01:56:58.478872+00:00 [warning] <0.510.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2025-09-01 01:56:58.479582+00:00 [info] <0.501.0> Started message store of type persistent for vhost '/'
2025-09-01 01:56:58.479767+00:00 [info] <0.501.0> Recovering 0 queues of type rabbit_classic_queue took 8ms
2025-09-01 01:56:58.479820+00:00 [info] <0.501.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2025-09-01 01:56:58.479852+00:00 [info] <0.501.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2025-09-01 01:56:58.481425+00:00 [info] <0.501.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-3995-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.530.0>
2025-09-01 01:56:58.481762+00:00 [info] <0.501.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.534.0>
2025-09-01 01:56:58.482010+00:00 [info] <0.501.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.538.0>
2025-09-01 01:56:58.482285+00:00 [info] <0.501.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-3995-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.542.0>
2025-09-01 01:56:58.482563+00:00 [info] <0.501.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3995-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.546.0>
2025-09-01 01:56:58.483034+00:00 [info] <0.501.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-3995-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.550.0>
2025-09-01 01:56:58.483381+00:00 [info] <0.501.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.554.0>
2025-09-01 01:56:58.483720+00:00 [info] <0.501.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3995-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.558.0>
2025-09-01 01:56:58.484101+00:00 [info] <0.501.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3995-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.562.0>
2025-09-01 01:56:58.484302+00:00 [info] <0.501.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-3995-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.565.0>
2025-09-01 01:56:58.484618+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2025-09-01 01:56:58.484682+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2025-09-01 01:56:58.484714+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-09-01 01:56:58.484758+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-09-01 01:56:58.484963+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2025-09-01 01:56:58.485092+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2025-09-01 01:56:58.485121+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2025-09-01 01:56:58.485142+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2025-09-01 01:56:58.485167+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2025-09-01 01:56:58.485278+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2025-09-01 01:56:58.485446+00:00 [info] <0.358.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2025-09-01 01:56:58.486340+00:00 [info] <0.458.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-1' up
2025-09-01 01:56:58.487105+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2025-09-01 01:56:58.487174+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2025-09-01 01:56:58.487329+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2025-09-01 01:56:58.487469+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2025-09-01 01:56:58.489745+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2025-09-01 01:56:58.491005+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2025-09-01 01:56:58.491059+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2025-09-01 01:56:58.491161+00:00 [info] <0.222.0> Importing concurrently 1 users...
2025-09-01 01:56:58.497387+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2025-09-01 01:56:58.509346+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2025-09-01 01:56:58.514216+00:00 [info] <0.575.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2025-09-01 01:56:58.514396+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2025-09-01 01:56:58.521724+00:00 [info] <0.628.0> Resetting node maintenance status
2025-09-01 01:56:58.564639+00:00 [info] <0.458.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-3' up
2025-09-01 01:56:58.589189+00:00 [info] <0.696.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-09-01 01:56:58.589473+00:00 [info] <0.724.0> Statistics database started.
2025-09-01 01:56:58.589563+00:00 [info] <0.723.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-09-01 01:56:58.598501+00:00 [info] <0.738.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2025-09-01 01:56:58.598653+00:00 [info] <0.628.0> Ready to start client connection listeners
2025-09-01 01:56:58.600276+00:00 [info] <0.782.0> started TCP listener on 10.0.0.38:5673
2025-09-01 01:56:58.680971+00:00 [info] <0.628.0> Server startup complete; 4 plugins started.
2025-09-01 01:56:58.680971+00:00 [info] <0.628.0>  * rabbitmq_prometheus
2025-09-01 01:56:58.680971+00:00 [info] <0.628.0>  * rabbitmq_management
2025-09-01 01:56:58.680971+00:00 [info] <0.628.0>  * rabbitmq_web_dispatch
2025-09-01 01:56:58.680971+00:00 [info] <0.628.0>  * rabbitmq_management_agent
2025-09-01 01:57:36.163798+00:00 [info] <0.1018.0> RabbitMQ is asked to stop...
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0> Stopping RabbitMQ applications and their dependencies in the following order:
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbitmq_management
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbitmq_prometheus
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbitmq_web_dispatch
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     cowboy
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     cowlib
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbitmq_management_agent
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbit
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     amqp_client
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbitmq_prelaunch
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     rabbit_common
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     prometheus
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     ra
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     accept
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     os_mon
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     sysmon_handler
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     osiris
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0>     mnesia
2025-09-01 01:57:36.194809+00:00 [info] <0.1018.0> 
2025-09-01 01:57:36.194975+00:00 [info] <0.1018.0> Stopping application 'rabbitmq_management'
2025-09-01 01:57:36.196954+00:00 [warning] <0.688.0> HTTP listener registry could not find context rabbitmq_management_tls
2025-09-01 01:57:36.199101+00:00 [notice] <0.44.0> Application rabbitmq_management exited with reason: stopped
2025-09-01 01:57:36.199199+00:00 [info] <0.1018.0> Stopping application 'rabbitmq_prometheus'
2025-09-01 01:57:36.200348+00:00 [warning] <0.688.0> HTTP listener registry could not find context rabbitmq_prometheus_tls
2025-09-01 01:57:36.202174+00:00 [notice] <0.44.0> Application rabbitmq_prometheus exited with reason: stopped
2025-09-01 01:57:36.202256+00:00 [info] <0.1018.0> Stopping application 'rabbitmq_web_dispatch'
2025-09-01 01:57:36.203968+00:00 [notice] <0.44.0> Application rabbitmq_web_dispatch exited with reason: stopped
2025-09-01 01:57:36.204029+00:00 [info] <0.1018.0> Stopping application 'cowboy'
2025-09-01 01:57:36.205643+00:00 [notice] <0.44.0> Application cowboy exited with reason: stopped
2025-09-01 01:57:36.205692+00:00 [info] <0.1018.0> Stopping application 'cowlib'
2025-09-01 01:57:36.205734+00:00 [notice] <0.44.0> Application cowlib exited with reason: stopped
2025-09-01 01:57:36.205764+00:00 [info] <0.1018.0> Stopping application 'rabbitmq_management_agent'
2025-09-01 01:57:36.207698+00:00 [notice] <0.44.0> Application rabbitmq_management_agent exited with reason: stopped
2025-09-01 01:57:36.207787+00:00 [info] <0.1018.0> Stopping application 'rabbit'
2025-09-01 01:57:36.207910+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping unregistration.
2025-09-01 01:57:36.208015+00:00 [info] <0.782.0> stopped TCP listener on 10.0.0.38:5673
2025-09-01 01:57:36.208743+00:00 [info] <0.1019.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2' because the vhost is stopping
2025-09-01 01:57:36.209370+00:00 [info] <0.510.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent'
2025-09-01 01:57:36.216898+00:00 [info] <0.510.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped
2025-09-01 01:57:36.217021+00:00 [info] <0.506.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient'
2025-09-01 01:57:36.222332+00:00 [info] <0.506.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped
2025-09-01 01:57:36.225976+00:00 [info] <0.449.0> Management plugin: to stop collect_statistics.
2025-09-01 01:57:41.229345+00:00 [notice] <0.44.0> Application rabbit exited with reason: stopped
2025-09-01 01:57:41.229496+00:00 [info] <0.1018.0> Stopping application 'amqp_client'
2025-09-01 01:57:41.232280+00:00 [notice] <0.44.0> Application amqp_client exited with reason: stopped
2025-09-01 01:57:41.232396+00:00 [info] <0.1018.0> Stopping application 'rabbitmq_prelaunch'
2025-09-01 01:57:41.234228+00:00 [notice] <0.44.0> Application rabbitmq_prelaunch exited with reason: stopped
2025-09-01 01:57:41.234297+00:00 [info] <0.1018.0> Stopping application 'rabbit_common'
2025-09-01 01:57:41.234333+00:00 [notice] <0.44.0> Application rabbit_common exited with reason: stopped
2025-09-01 01:57:41.234381+00:00 [info] <0.1018.0> Stopping application 'prometheus'
2025-09-01 01:57:41.235986+00:00 [notice] <0.44.0> Application prometheus exited with reason: stopped
2025-09-01 01:57:41.236034+00:00 [info] <0.1018.0> Stopping application 'ra'
2025-09-01 01:57:41.239004+00:00 [notice] <0.44.0> Application ra exited with reason: stopped
2025-09-01 01:57:41.239074+00:00 [info] <0.1018.0> Stopping application 'accept'
2025-09-01 01:57:41.239111+00:00 [notice] <0.44.0> Application accept exited with reason: stopped
2025-09-01 01:57:41.239147+00:00 [info] <0.1018.0> Stopping application 'os_mon'
2025-09-01 01:57:41.240700+00:00 [notice] <0.44.0> Application os_mon exited with reason: stopped
2025-09-01 01:57:41.240774+00:00 [info] <0.1018.0> Stopping application 'sysmon_handler'
2025-09-01 01:57:41.242609+00:00 [notice] <0.44.0> Application sysmon_handler exited with reason: stopped
2025-09-01 01:57:41.242693+00:00 [info] <0.1018.0> Stopping application 'osiris'
2025-09-01 01:57:41.244283+00:00 [notice] <0.44.0> Application osiris exited with reason: stopped
2025-09-01 01:57:41.244353+00:00 [info] <0.1018.0> Stopping application 'mnesia'
2025-09-01 01:57:41.250016+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:57:41.250107+00:00 [info] <0.1018.0> Successfully stopped RabbitMQ and its dependencies
2025-09-01 01:57:48.438337+00:00 [info] <0.1041.0> Resetting Rabbit forcefully
2025-09-01 01:57:48.995916+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:57:49.010975+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:57:49.130896+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.131087+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.146939+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.147170+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.147282+00:00 [warning] <0.1047.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-feature_flags`:
2025-09-01 01:57:49.147333+00:00 [warning] <0.1047.0> Feature flags:   - list of previously disabled feature flags now marked as such: [maintenance_mode_status]
2025-09-01 01:57:49.157628+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.157786+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.174125+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 0 retries left
2025-09-01 01:57:49.174319+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.181608+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:57:49.196660+00:00 [info] <0.1047.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-3995-3',
2025-09-01 01:57:49.196660+00:00 [info] <0.1047.0>                  'contrail@cn-jenkins-deploy-platform-ansible-os-3995-1'] as disc node
2025-09-01 01:57:49.241720+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.242002+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.561293+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.561568+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.561624+00:00 [warning] <0.1047.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-feature_flags`:
2025-09-01 01:57:49.561673+00:00 [warning] <0.1047.0> Feature flags:   - list of previously enabled feature flags now marked as such: [maintenance_mode_status]
2025-09-01 01:57:49.564568+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.564795+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.591480+00:00 [info] <0.1047.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:49.591882+00:00 [info] <0.1047.0> Successfully synced tables from a peer
2025-09-01 01:57:49.603280+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:57:49.603499+00:00 [error] <0.1047.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': {node_not_running,
2025-09-01 01:57:49.603499+00:00 [error] <0.1047.0>                                                                                                                'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'}
2025-09-01 01:57:49.603955+00:00 [info] <0.1047.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:49.605546+00:00 [error] <0.1047.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': {node_not_running,
2025-09-01 01:57:49.605546+00:00 [error] <0.1047.0>                                                                                                                          'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'}
2025-09-01 01:57:49.606028+00:00 [info] <0.1047.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:49.606244+00:00 [error] <0.1047.0> Failed to create a per-user tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': {node_not_running,
2025-09-01 01:57:49.606244+00:00 [error] <0.1047.0>                                                                                                                         'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'}
2025-09-01 01:57:49.606344+00:00 [info] <0.1047.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0> Halting Erlang VM with the following applications:
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     amqp10_common
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     observer_cli
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     stdout_formatter
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     seshat
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     gen_batch_server
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     aten
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     ranch
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     inets
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     systemd
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     enough
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     cuttlefish
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     credentials_obfuscation
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     recon
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     jsx
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     xmerl
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     tools
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     syntax_tools
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     ssl
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     public_key
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     asn1
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     crypto
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     compiler
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     sasl
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     stdlib
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0>     kernel
2025-09-01 01:57:50.508773+00:00 [info] <0.1410.0> 
2025-09-01 01:57:54.747130+00:00 [notice] <0.222.0> Logging: configured log handlers are now ACTIVE
2025-09-01 01:57:56.567647+00:00 [info] <0.222.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-upgrade-backup"
2025-09-01 01:57:56.571755+00:00 [info] <0.222.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-upgrade-backup"
2025-09-01 01:57:56.589071+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2025-09-01 01:57:56.590555+00:00 [info] <0.222.0> Feature flags: list of feature flags found:
2025-09-01 01:57:56.590605+00:00 [info] <0.222.0> Feature flags:   [x] classic_mirrored_queue_version
2025-09-01 01:57:56.590643+00:00 [info] <0.222.0> Feature flags:   [x] drop_unroutable_metric
2025-09-01 01:57:56.590670+00:00 [info] <0.222.0> Feature flags:   [x] empty_basic_get_metric
2025-09-01 01:57:56.590689+00:00 [info] <0.222.0> Feature flags:   [x] implicit_default_bindings
2025-09-01 01:57:56.590733+00:00 [info] <0.222.0> Feature flags:   [x] maintenance_mode_status
2025-09-01 01:57:56.590761+00:00 [info] <0.222.0> Feature flags:   [x] quorum_queue
2025-09-01 01:57:56.590778+00:00 [info] <0.222.0> Feature flags:   [x] stream_queue
2025-09-01 01:57:56.590795+00:00 [info] <0.222.0> Feature flags:   [x] user_limits
2025-09-01 01:57:56.590857+00:00 [info] <0.222.0> Feature flags:   [x] virtual_host_metadata
2025-09-01 01:57:56.590877+00:00 [info] <0.222.0> Feature flags: feature flag states written to disk: yes
2025-09-01 01:57:56.653560+00:00 [info] <0.222.0> ra: starting system quorum_queues
2025-09-01 01:57:56.653640+00:00 [info] <0.222.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/quorum/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:57:56.654761+00:00 [info] <0.313.0> ra system 'quorum_queues' running pre init for 0 registered servers
2025-09-01 01:57:56.655814+00:00 [info] <0.314.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2025-09-01 01:57:56.655979+00:00 [notice] <0.319.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2025-09-01 01:57:56.660483+00:00 [info] <0.222.0> ra: starting system coordination
2025-09-01 01:57:56.660566+00:00 [info] <0.222.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/coordination/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:57:56.661950+00:00 [info] <0.337.0> ra system 'coordination' running pre init for 0 registered servers
2025-09-01 01:57:56.662479+00:00 [info] <0.338.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2025-09-01 01:57:56.662654+00:00 [notice] <0.343.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2025-09-01 01:57:56.666096+00:00 [info] <0.222.0> 
2025-09-01 01:57:56.666096+00:00 [info] <0.222.0>  Starting RabbitMQ 3.10.7 on Erlang 25.0.4 [jit]
2025-09-01 01:57:56.666096+00:00 [info] <0.222.0>  Copyright (c) 2007-2022 VMware, Inc. or its affiliates.
2025-09-01 01:57:56.666096+00:00 [info] <0.222.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0> 
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>  node           : contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>  home dir       : /var/lib/rabbitmq
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>  config file(s) : /etc/rabbitmq/rabbitmq.config
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>                 : /etc/rabbitmq/conf.d/10-defaults.conf
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>  cookie hash    : esZsDxSN6VGbi9JkMSxNZA==
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>  log(s)         : /var/log/contrail/config-database-rabbitmq/rabbitmq.log
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>                 : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2_upgrade.log
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>                 : <stdout>
2025-09-01 01:57:56.667405+00:00 [info] <0.222.0>  database dir   : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2
2025-09-01 01:57:56.872898+00:00 [info] <0.222.0> Feature flag `drop_unroutable_metric`: mark as enabled=true
2025-09-01 01:57:56.874485+00:00 [info] <0.222.0> Feature flag `empty_basic_get_metric`: mark as enabled=true
2025-09-01 01:57:57.071461+00:00 [info] <0.222.0> Running boot step pre_boot defined by app rabbit
2025-09-01 01:57:57.071577+00:00 [info] <0.222.0> Running boot step rabbit_global_counters defined by app rabbit
2025-09-01 01:57:57.071859+00:00 [info] <0.222.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2025-09-01 01:57:57.072024+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics defined by app rabbit
2025-09-01 01:57:57.072480+00:00 [info] <0.222.0> Running boot step rabbit_alarm defined by app rabbit
2025-09-01 01:57:57.076127+00:00 [info] <0.418.0> Memory high watermark set to 12637 MiB (13251081011 bytes) of 15796 MiB (16563851264 bytes) total
2025-09-01 01:57:57.079966+00:00 [info] <0.420.0> Enabling free disk space monitoring
2025-09-01 01:57:57.080014+00:00 [info] <0.420.0> Disk free limit set to 50MB
2025-09-01 01:57:57.082628+00:00 [info] <0.222.0> Running boot step code_server_cache defined by app rabbit
2025-09-01 01:57:57.082723+00:00 [info] <0.222.0> Running boot step file_handle_cache defined by app rabbit
2025-09-01 01:57:57.082946+00:00 [info] <0.425.0> Limiting to approx 1048479 file handles (943629 sockets)
2025-09-01 01:57:57.083054+00:00 [info] <0.426.0> FHC read buffering: OFF
2025-09-01 01:57:57.083089+00:00 [info] <0.426.0> FHC write buffering: ON
2025-09-01 01:57:57.083391+00:00 [info] <0.222.0> Running boot step worker_pool defined by app rabbit
2025-09-01 01:57:57.083450+00:00 [info] <0.345.0> Will use 4 processes for default worker pool
2025-09-01 01:57:57.083497+00:00 [info] <0.345.0> Starting worker pool 'worker_pool' with 4 processes in it
2025-09-01 01:57:57.083792+00:00 [info] <0.222.0> Running boot step database defined by app rabbit
2025-09-01 01:57:57.086079+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:57.090272+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:57:57.090762+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:57.090860+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:57:57.090908+00:00 [warning] <0.222.0> Feature flags: the previous instance of this node must have failed to write the `feature_flags` file at `/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2-feature_flags`:
2025-09-01 01:57:57.090948+00:00 [warning] <0.222.0> Feature flags:   - list of previously disabled feature flags now marked as such: [empty_basic_get_metric]
2025-09-01 01:57:57.094194+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:57.094424+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:57:57.110052+00:00 [info] <0.222.0> upgrades: Mnesia backup removed
2025-09-01 01:57:57.110137+00:00 [info] <0.222.0> Waiting for Mnesia tables for 30000 ms, 9 retries left
2025-09-01 01:57:57.110263+00:00 [info] <0.222.0> Successfully synced tables from a peer
2025-09-01 01:57:57.110294+00:00 [info] <0.222.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration.
2025-09-01 01:57:57.110369+00:00 [info] <0.222.0> Running boot step database_sync defined by app rabbit
2025-09-01 01:57:57.110446+00:00 [info] <0.222.0> Running boot step feature_flags defined by app rabbit
2025-09-01 01:57:57.110620+00:00 [info] <0.222.0> Running boot step codec_correctness_check defined by app rabbit
2025-09-01 01:57:57.110650+00:00 [info] <0.222.0> Running boot step external_infrastructure defined by app rabbit
2025-09-01 01:57:57.110671+00:00 [info] <0.222.0> Running boot step rabbit_event defined by app rabbit
2025-09-01 01:57:57.110764+00:00 [info] <0.222.0> Running boot step rabbit_registry defined by app rabbit
2025-09-01 01:57:57.110822+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit
2025-09-01 01:57:57.110871+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit
2025-09-01 01:57:57.110940+00:00 [info] <0.222.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit
2025-09-01 01:57:57.110984+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_direct defined by app rabbit
2025-09-01 01:57:57.111084+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit
2025-09-01 01:57:57.111128+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_headers defined by app rabbit
2025-09-01 01:57:57.111174+00:00 [info] <0.222.0> Running boot step rabbit_exchange_type_topic defined by app rabbit
2025-09-01 01:57:57.111218+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit
2025-09-01 01:57:57.111284+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit
2025-09-01 01:57:57.111349+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit
2025-09-01 01:57:57.111417+00:00 [info] <0.222.0> Running boot step rabbit_priority_queue defined by app rabbit
2025-09-01 01:57:57.111447+00:00 [info] <0.222.0> Priority queues enabled, real BQ is rabbit_variable_queue
2025-09-01 01:57:57.111576+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_client_local defined by app rabbit
2025-09-01 01:57:57.111721+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit
2025-09-01 01:57:57.112101+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_random defined by app rabbit
2025-09-01 01:57:57.112212+00:00 [info] <0.222.0> Running boot step kernel_ready defined by app rabbit
2025-09-01 01:57:57.112264+00:00 [info] <0.222.0> Running boot step rabbit_sysmon_minder defined by app rabbit
2025-09-01 01:57:57.112478+00:00 [info] <0.222.0> Running boot step rabbit_epmd_monitor defined by app rabbit
2025-09-01 01:57:57.113357+00:00 [info] <0.450.0> epmd monitor knows us, inter-node communication (distribution) port: 25673
2025-09-01 01:57:57.113490+00:00 [info] <0.222.0> Running boot step guid_generator defined by app rabbit
2025-09-01 01:57:57.117679+00:00 [info] <0.222.0> Running boot step rabbit_node_monitor defined by app rabbit
2025-09-01 01:57:57.118811+00:00 [info] <0.454.0> Starting rabbit_node_monitor
2025-09-01 01:57:57.118947+00:00 [info] <0.222.0> Running boot step delegate_sup defined by app rabbit
2025-09-01 01:57:57.119377+00:00 [info] <0.222.0> Running boot step rabbit_memory_monitor defined by app rabbit
2025-09-01 01:57:57.119556+00:00 [info] <0.222.0> Running boot step rabbit_fifo_dlx_sup defined by app rabbit
2025-09-01 01:57:57.119627+00:00 [info] <0.222.0> Running boot step core_initialized defined by app rabbit
2025-09-01 01:57:57.119659+00:00 [info] <0.222.0> Running boot step upgrade_queues defined by app rabbit
2025-09-01 01:57:57.127063+00:00 [info] <0.222.0> message_store upgrades: 1 to apply
2025-09-01 01:57:57.127211+00:00 [info] <0.222.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store
2025-09-01 01:57:57.127382+00:00 [info] <0.222.0> message_store upgrades: No durable queues found. Skipping message store migration
2025-09-01 01:57:57.127469+00:00 [info] <0.222.0> message_store upgrades: Removing the old message store data
2025-09-01 01:57:57.127870+00:00 [info] <0.222.0> message_store upgrades: All upgrades applied successfully
2025-09-01 01:57:57.136868+00:00 [info] <0.222.0> Running boot step channel_tracking defined by app rabbit
2025-09-01 01:57:57.144914+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:57.153327+00:00 [info] <0.222.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:57.153545+00:00 [info] <0.222.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit
2025-09-01 01:57:57.153613+00:00 [info] <0.222.0> Running boot step connection_tracking defined by app rabbit
2025-09-01 01:57:57.159824+00:00 [info] <0.222.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:57.168390+00:00 [info] <0.222.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:57.174258+00:00 [info] <0.222.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3995-2'
2025-09-01 01:57:57.174594+00:00 [info] <0.222.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit
2025-09-01 01:57:57.174671+00:00 [info] <0.222.0> Running boot step rabbit_definitions_hashing defined by app rabbit
2025-09-01 01:57:57.174771+00:00 [info] <0.222.0> Running boot step rabbit_exchange_parameters defined by app rabbit
2025-09-01 01:57:57.174877+00:00 [info] <0.222.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit
2025-09-01 01:57:57.175088+00:00 [info] <0.222.0> Running boot step rabbit_policies defined by app rabbit
2025-09-01 01:57:57.175344+00:00 [info] <0.222.0> Running boot step rabbit_policy defined by app rabbit
2025-09-01 01:57:57.175403+00:00 [info] <0.222.0> Running boot step rabbit_queue_location_validator defined by app rabbit
2025-09-01 01:57:57.175479+00:00 [info] <0.222.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit
2025-09-01 01:57:57.175527+00:00 [info] <0.222.0> Running boot step rabbit_stream_coordinator defined by app rabbit
2025-09-01 01:57:57.175675+00:00 [info] <0.222.0> Running boot step rabbit_vhost_limit defined by app rabbit
2025-09-01 01:57:57.175820+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management
2025-09-01 01:57:57.175905+00:00 [info] <0.222.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent
2025-09-01 01:57:57.175962+00:00 [warning] <0.222.0> force_fine_statistics set to true; ignored.
2025-09-01 01:57:57.175962+00:00 [warning] <0.222.0> Replaced by {rates_mode, none} in the rabbitmq_management application.
2025-09-01 01:57:57.176010+00:00 [info] <0.222.0> Management plugin: using rates mode 'basic'
2025-09-01 01:57:57.178211+00:00 [info] <0.222.0> Running boot step recovery defined by app rabbit
2025-09-01 01:57:57.180104+00:00 [info] <0.512.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3995-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists
2025-09-01 01:57:57.181245+00:00 [info] <0.512.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048'
2025-09-01 01:57:57.185328+00:00 [info] <0.512.0> Starting message stores for vhost '/'
2025-09-01 01:57:57.185650+00:00 [info] <0.517.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index
2025-09-01 01:57:57.186968+00:00 [info] <0.512.0> Started message store of type transient for vhost '/'
2025-09-01 01:57:57.187279+00:00 [info] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index
2025-09-01 01:57:57.188016+00:00 [warning] <0.521.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch
2025-09-01 01:57:57.188877+00:00 [info] <0.512.0> Started message store of type persistent for vhost '/'
2025-09-01 01:57:57.189020+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_classic_queue took 7ms
2025-09-01 01:57:57.189085+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms
2025-09-01 01:57:57.189129+00:00 [info] <0.512.0> Recovering 0 queues of type rabbit_stream_queue took 0ms
2025-09-01 01:57:57.190602+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-3995-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.541.0>
2025-09-01 01:57:57.190931+00:00 [info] <0.512.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.545.0>
2025-09-01 01:57:57.191176+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.549.0>
2025-09-01 01:57:57.191444+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-3995-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.553.0>
2025-09-01 01:57:57.191717+00:00 [info] <0.512.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-3995-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.557.0>
2025-09-01 01:57:57.191957+00:00 [info] <0.512.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-3995-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.561.0>
2025-09-01 01:57:57.192238+00:00 [info] <0.512.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-3995-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.565.0>
2025-09-01 01:57:57.192626+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-3995-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.569.0>
2025-09-01 01:57:57.193176+00:00 [info] <0.512.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.574.0>
2025-09-01 01:57:57.193517+00:00 [info] <0.512.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-3995-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.578.0>
2025-09-01 01:57:57.193837+00:00 [info] <0.512.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-3995-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.583.0>
2025-09-01 01:57:57.194486+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3995-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.589.0>
2025-09-01 01:57:57.194912+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-3995-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.593.0>
2025-09-01 01:57:57.195524+00:00 [info] <0.512.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-3995-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.597.0>
2025-09-01 01:57:57.195846+00:00 [info] <0.512.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-3995-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-2': <0.603.0>
2025-09-01 01:57:57.196002+00:00 [info] <0.222.0> Running boot step empty_db_check defined by app rabbit
2025-09-01 01:57:57.196045+00:00 [info] <0.222.0> Will not seed default virtual host and user: have definitions to load...
2025-09-01 01:57:57.196069+00:00 [info] <0.222.0> Running boot step rabbit_looking_glass defined by app rabbit
2025-09-01 01:57:57.196110+00:00 [info] <0.222.0> Running boot step rabbit_core_metrics_gc defined by app rabbit
2025-09-01 01:57:57.196253+00:00 [info] <0.222.0> Running boot step background_gc defined by app rabbit
2025-09-01 01:57:57.196385+00:00 [info] <0.222.0> Running boot step routing_ready defined by app rabbit
2025-09-01 01:57:57.196438+00:00 [info] <0.222.0> Running boot step pre_flight defined by app rabbit
2025-09-01 01:57:57.196469+00:00 [info] <0.222.0> Running boot step notify_cluster defined by app rabbit
2025-09-01 01:57:57.196508+00:00 [info] <0.222.0> Running boot step networking defined by app rabbit
2025-09-01 01:57:57.196569+00:00 [info] <0.222.0> Running boot step definition_import_worker_pool defined by app rabbit
2025-09-01 01:57:57.196634+00:00 [info] <0.345.0> Starting worker pool 'definition_import_pool' with 4 processes in it
2025-09-01 01:57:57.197073+00:00 [info] <0.222.0> Running boot step cluster_name defined by app rabbit
2025-09-01 01:57:57.197129+00:00 [info] <0.222.0> Running boot step direct_client defined by app rabbit
2025-09-01 01:57:57.197186+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-1' up
2025-09-01 01:57:57.197229+00:00 [info] <0.222.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit
2025-09-01 01:57:57.197277+00:00 [info] <0.222.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status`
2025-09-01 01:57:57.201587+00:00 [info] <0.222.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management
2025-09-01 01:57:57.202084+00:00 [info] <0.222.0> Applying definitions from file at '/etc/rabbitmq/definitions.json'
2025-09-01 01:57:57.202129+00:00 [info] <0.222.0> Asked to import definitions. Acting user: rmq-internal
2025-09-01 01:57:57.202255+00:00 [info] <0.222.0> Importing concurrently 1 users...
2025-09-01 01:57:57.208810+00:00 [info] <0.222.0> Importing concurrently 1 vhosts...
2025-09-01 01:57:57.220730+00:00 [info] <0.222.0> Importing concurrently 1 permissions...
2025-09-01 01:57:57.227832+00:00 [info] <0.611.0> Successfully set permissions for 'guest' in virtual host '/' to '.*', '.*', '.*'
2025-09-01 01:57:57.228047+00:00 [info] <0.222.0> Importing sequentially 1 policies...
2025-09-01 01:57:57.253280+00:00 [info] <0.454.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-3995-3' up
2025-09-01 01:57:57.257252+00:00 [info] <0.680.0> Resetting node maintenance status
2025-09-01 01:57:57.279252+00:00 [info] <0.740.0> Management plugin: HTTP (non-TLS) listener started on port 15673
2025-09-01 01:57:57.279447+00:00 [info] <0.768.0> Statistics database started.
2025-09-01 01:57:57.279560+00:00 [info] <0.767.0> Starting worker pool 'management_worker_pool' with 3 processes in it
2025-09-01 01:57:57.287857+00:00 [info] <0.782.0> Prometheus metrics: HTTP (non-TLS) listener started on port 15692
2025-09-01 01:57:57.288018+00:00 [info] <0.680.0> Ready to start client connection listeners
2025-09-01 01:57:57.289376+00:00 [info] <0.826.0> started TCP listener on 10.0.0.38:5673
2025-09-01 01:57:57.349966+00:00 [info] <0.680.0> Server startup complete; 4 plugins started.
2025-09-01 01:57:57.349966+00:00 [info] <0.680.0>  * rabbitmq_prometheus
2025-09-01 01:57:57.349966+00:00 [info] <0.680.0>  * rabbitmq_management
2025-09-01 01:57:57.349966+00:00 [info] <0.680.0>  * rabbitmq_web_dispatch
2025-09-01 01:57:57.349966+00:00 [info] <0.680.0>  * rabbitmq_management_agent