2025-04-14 02:06:35.275895+00:00 [notice] <0.234.0> Logging: configured log handlers are now ACTIVE 2025-04-14 02:06:35.406065+00:00 [info] <0.234.0> ra: starting system quorum_queues 2025-04-14 02:06:35.406153+00:00 [info] <0.234.0> starting Ra system: quorum_queues in directory: /var/lib/rabbitmq/mnesia/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1/quorum/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1 2025-04-14 02:06:35.442850+00:00 [info] <0.281.0> ra system 'quorum_queues' running pre init for 0 registered servers 2025-04-14 02:06:35.449007+00:00 [info] <0.282.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered 2025-04-14 02:06:35.457583+00:00 [notice] <0.287.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables 2025-04-14 02:06:35.464289+00:00 [info] <0.234.0> ra: starting system coordination 2025-04-14 02:06:35.464350+00:00 [info] <0.234.0> starting Ra system: coordination in directory: /var/lib/rabbitmq/mnesia/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1/coordination/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1 2025-04-14 02:06:35.465241+00:00 [info] <0.294.0> ra system 'coordination' running pre init for 0 registered servers 2025-04-14 02:06:35.465723+00:00 [info] <0.295.0> ra: meta data store initialised for system coordination. 0 record(s) recovered 2025-04-14 02:06:35.465872+00:00 [notice] <0.300.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables 2025-04-14 02:06:35.474599+00:00 [info] <0.234.0> 2025-04-14 02:06:35.474599+00:00 [info] <0.234.0> Starting RabbitMQ 3.9.29 on Erlang 25.2.3 [jit] 2025-04-14 02:06:35.474599+00:00 [info] <0.234.0> Copyright (c) 2007-2023 VMware, Inc. or its affiliates. 2025-04-14 02:06:35.474599+00:00 [info] <0.234.0> Licensed under the MPL 2.0. Website: https://rabbitmq.com 2025-04-14 02:06:35.474685+00:00 [error] <0.234.0> This release series has reached end of life and is no longer supported. Please visit https://rabbitmq.com/versions.html to learn more and upgrade 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> node : rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> home dir : /var/lib/rabbitmq 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> config file(s) : /etc/rabbitmq/advanced.config 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> : /etc/rabbitmq/rabbitmq.conf 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> cookie hash : pSQUpsDOPNKoB1+tEZ0xhQ== 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> log(s) : /var/log/kolla/rabbitmq/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1.log 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> : /var/log/kolla/rabbitmq/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1_upgrade.log 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> : 2025-04-14 02:06:35.476018+00:00 [info] <0.234.0> database dir : /var/lib/rabbitmq/mnesia/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1 2025-04-14 02:06:35.637229+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:35.637310+00:00 [info] <0.234.0> Feature flags: [ ] drop_unroutable_metric 2025-04-14 02:06:35.637333+00:00 [info] <0.234.0> Feature flags: [ ] empty_basic_get_metric 2025-04-14 02:06:35.637350+00:00 [info] <0.234.0> Feature flags: [ ] implicit_default_bindings 2025-04-14 02:06:35.637410+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:35.637436+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:35.637452+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:35.637466+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:35.637519+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:35.637537+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.332816+00:00 [info] <0.234.0> Running boot step pre_boot defined by app rabbit 2025-04-14 02:06:37.332901+00:00 [info] <0.234.0> Running boot step rabbit_global_counters defined by app rabbit 2025-04-14 02:06:37.333115+00:00 [info] <0.234.0> Running boot step rabbit_osiris_metrics defined by app rabbit 2025-04-14 02:06:37.333219+00:00 [info] <0.234.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-04-14 02:06:37.333607+00:00 [info] <0.234.0> Running boot step rabbit_alarm defined by app rabbit 2025-04-14 02:06:37.338483+00:00 [info] <0.331.0> Memory high watermark set to 12759 MiB (13379631513 bytes) of 31899 MiB (33449078784 bytes) total 2025-04-14 02:06:37.342351+00:00 [info] <0.333.0> Enabling free disk space monitoring 2025-04-14 02:06:37.342395+00:00 [info] <0.333.0> Disk free limit set to 50MB 2025-04-14 02:06:37.344594+00:00 [info] <0.234.0> Running boot step code_server_cache defined by app rabbit 2025-04-14 02:06:37.344740+00:00 [info] <0.234.0> Running boot step file_handle_cache defined by app rabbit 2025-04-14 02:06:37.345013+00:00 [info] <0.336.0> Limiting to approx 1048479 file handles (943629 sockets) 2025-04-14 02:06:37.345164+00:00 [info] <0.337.0> FHC read buffering: OFF 2025-04-14 02:06:37.345199+00:00 [info] <0.337.0> FHC write buffering: ON 2025-04-14 02:06:37.345527+00:00 [info] <0.234.0> Running boot step worker_pool defined by app rabbit 2025-04-14 02:06:37.345583+00:00 [info] <0.302.0> Will use 2 processes for default worker pool 2025-04-14 02:06:37.345618+00:00 [info] <0.302.0> Starting worker pool 'worker_pool' with 2 processes in it 2025-04-14 02:06:37.345851+00:00 [info] <0.234.0> Running boot step database defined by app rabbit 2025-04-14 02:06:37.346149+00:00 [info] <0.234.0> Node database directory at /var/lib/rabbitmq/mnesia/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-04-14 02:06:37.346204+00:00 [info] <0.234.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-04-14 02:06:37.346230+00:00 [info] <0.234.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-04-14 02:06:37.346353+00:00 [info] <0.234.0> All discovered existing cluster peers: rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1 2025-04-14 02:06:37.346381+00:00 [info] <0.234.0> Discovered no peer nodes to cluster with. Some discovery backends can filter nodes out based on a readiness criteria. Enabling debug logging might help troubleshoot. 2025-04-14 02:06:37.348276+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped 2025-04-14 02:06:37.446669+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.446838+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.456848+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.456979+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.457032+00:00 [info] <0.234.0> Feature flag `drop_unroutable_metric`: supported, attempt to enable... 2025-04-14 02:06:37.457122+00:00 [info] <0.234.0> Feature flag `drop_unroutable_metric`: mark as enabled=state_changing 2025-04-14 02:06:37.457941+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.457986+00:00 [info] <0.234.0> Feature flags: [~] drop_unroutable_metric 2025-04-14 02:06:37.458005+00:00 [info] <0.234.0> Feature flags: [ ] empty_basic_get_metric 2025-04-14 02:06:37.458053+00:00 [info] <0.234.0> Feature flags: [ ] implicit_default_bindings 2025-04-14 02:06:37.458070+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:37.458090+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.458192+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.458258+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.458284+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.458306+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.466802+00:00 [info] <0.234.0> Feature flag `drop_unroutable_metric`: mark as enabled=true 2025-04-14 02:06:37.468126+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.468199+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.468229+00:00 [info] <0.234.0> Feature flags: [ ] empty_basic_get_metric 2025-04-14 02:06:37.468246+00:00 [info] <0.234.0> Feature flags: [ ] implicit_default_bindings 2025-04-14 02:06:37.468301+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:37.468320+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.468354+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.468372+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.468426+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.468444+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.476180+00:00 [info] <0.234.0> Feature flag `empty_basic_get_metric`: supported, attempt to enable... 2025-04-14 02:06:37.476330+00:00 [info] <0.234.0> Feature flag `empty_basic_get_metric`: mark as enabled=state_changing 2025-04-14 02:06:37.477248+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.477318+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.477341+00:00 [info] <0.234.0> Feature flags: [~] empty_basic_get_metric 2025-04-14 02:06:37.477385+00:00 [info] <0.234.0> Feature flags: [ ] implicit_default_bindings 2025-04-14 02:06:37.477406+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:37.477430+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.477450+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.477480+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.477495+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.477512+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.485228+00:00 [info] <0.234.0> Feature flag `empty_basic_get_metric`: mark as enabled=true 2025-04-14 02:06:37.487193+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.487243+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.487273+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.487291+00:00 [info] <0.234.0> Feature flags: [ ] implicit_default_bindings 2025-04-14 02:06:37.487339+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:37.487358+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.487378+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.487426+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.487443+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.487459+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.494851+00:00 [info] <0.234.0> Feature flag `implicit_default_bindings`: supported, attempt to enable... 2025-04-14 02:06:37.494946+00:00 [info] <0.234.0> Feature flag `implicit_default_bindings`: mark as enabled=state_changing 2025-04-14 02:06:37.495779+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.495824+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.495843+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.495889+00:00 [info] <0.234.0> Feature flags: [~] implicit_default_bindings 2025-04-14 02:06:37.495905+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:37.495928+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.495972+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.495989+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.496004+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.496020+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.503690+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2025-04-14 02:06:37.503835+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.503876+00:00 [info] <0.234.0> Feature flag `implicit_default_bindings`: mark as enabled=true 2025-04-14 02:06:37.505655+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.505722+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.505742+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.505758+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.505797+00:00 [info] <0.234.0> Feature flags: [ ] maintenance_mode_status 2025-04-14 02:06:37.505821+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.505836+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.505850+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.505917+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.505936+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.512894+00:00 [info] <0.234.0> Feature flag `maintenance_mode_status`: supported, attempt to enable... 2025-04-14 02:06:37.513021+00:00 [info] <0.234.0> Feature flag `maintenance_mode_status`: mark as enabled=state_changing 2025-04-14 02:06:37.513831+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.513889+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.513910+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.513928+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.513945+00:00 [info] <0.234.0> Feature flags: [~] maintenance_mode_status 2025-04-14 02:06:37.513968+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.513989+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.514004+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.514030+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.514046+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.520657+00:00 [info] <0.234.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status` 2025-04-14 02:06:37.525693+00:00 [info] <0.234.0> Feature flag `maintenance_mode_status`: mark as enabled=true 2025-04-14 02:06:37.527639+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.527709+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.527733+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.527750+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.527786+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.527811+00:00 [info] <0.234.0> Feature flags: [ ] quorum_queue 2025-04-14 02:06:37.527827+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.527842+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.527887+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.527905+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.534766+00:00 [info] <0.234.0> Feature flag `quorum_queue`: supported, attempt to enable... 2025-04-14 02:06:37.534866+00:00 [info] <0.234.0> Feature flag `quorum_queue`: mark as enabled=state_changing 2025-04-14 02:06:37.535674+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.535752+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.535788+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.535820+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.535858+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.535890+00:00 [info] <0.234.0> Feature flags: [~] quorum_queue 2025-04-14 02:06:37.535914+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.535931+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.535952+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.535969+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.542546+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.542684+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.542720+00:00 [info] <0.234.0> Feature flag `quorum_queue`: migrating Mnesia table rabbit_queue... 2025-04-14 02:06:37.557852+00:00 [info] <0.234.0> Feature flag `quorum_queue`: migrating Mnesia table rabbit_durable_queue... 2025-04-14 02:06:37.572890+00:00 [info] <0.234.0> Feature flag `quorum_queue`: Mnesia tables migration done 2025-04-14 02:06:37.572967+00:00 [info] <0.234.0> Feature flag `quorum_queue`: mark as enabled=true 2025-04-14 02:06:37.574533+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.574600+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.574622+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.574640+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.574706+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.574733+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.574749+00:00 [info] <0.234.0> Feature flags: [ ] stream_queue 2025-04-14 02:06:37.574763+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.574787+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.574804+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.581897+00:00 [info] <0.234.0> Feature flag `stream_queue`: supported, attempt to enable... 2025-04-14 02:06:37.582015+00:00 [info] <0.234.0> Feature flag `stream_queue`: mark as enabled=state_changing 2025-04-14 02:06:37.582859+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.582925+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.582947+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.582967+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.582984+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.583013+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.583032+00:00 [info] <0.234.0> Feature flags: [~] stream_queue 2025-04-14 02:06:37.583096+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.583116+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.583133+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.592191+00:00 [info] <0.234.0> Feature flag `stream_queue`: mark as enabled=true 2025-04-14 02:06:37.593663+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.593732+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.593753+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.593769+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.593816+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.593843+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.593858+00:00 [info] <0.234.0> Feature flags: [x] stream_queue 2025-04-14 02:06:37.593896+00:00 [info] <0.234.0> Feature flags: [ ] user_limits 2025-04-14 02:06:37.593914+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.593930+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.602172+00:00 [info] <0.234.0> Feature flag `user_limits`: supported, attempt to enable... 2025-04-14 02:06:37.602266+00:00 [info] <0.234.0> Feature flag `user_limits`: mark as enabled=state_changing 2025-04-14 02:06:37.603100+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.603165+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.603186+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.603231+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.603291+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.603334+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.603368+00:00 [info] <0.234.0> Feature flags: [x] stream_queue 2025-04-14 02:06:37.603404+00:00 [info] <0.234.0> Feature flags: [~] user_limits 2025-04-14 02:06:37.603447+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.603482+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.611732+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.611875+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.629173+00:00 [info] <0.234.0> Feature flag `user_limits`: mark as enabled=true 2025-04-14 02:06:37.630629+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.630690+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.630725+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.630743+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.630786+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.630812+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.630828+00:00 [info] <0.234.0> Feature flags: [x] stream_queue 2025-04-14 02:06:37.630842+00:00 [info] <0.234.0> Feature flags: [x] user_limits 2025-04-14 02:06:37.630894+00:00 [info] <0.234.0> Feature flags: [ ] virtual_host_metadata 2025-04-14 02:06:37.630912+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.638090+00:00 [info] <0.234.0> Feature flag `virtual_host_metadata`: supported, attempt to enable... 2025-04-14 02:06:37.638187+00:00 [info] <0.234.0> Feature flag `virtual_host_metadata`: mark as enabled=state_changing 2025-04-14 02:06:37.638973+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.639035+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.639081+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.639118+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.639142+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.639171+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.639239+00:00 [info] <0.234.0> Feature flags: [x] stream_queue 2025-04-14 02:06:37.639258+00:00 [info] <0.234.0> Feature flags: [x] user_limits 2025-04-14 02:06:37.639274+00:00 [info] <0.234.0> Feature flags: [~] virtual_host_metadata 2025-04-14 02:06:37.639291+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.646335+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.646456+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.663758+00:00 [info] <0.234.0> Feature flag `virtual_host_metadata`: mark as enabled=true 2025-04-14 02:06:37.665249+00:00 [info] <0.234.0> Feature flags: list of feature flags found: 2025-04-14 02:06:37.665318+00:00 [info] <0.234.0> Feature flags: [x] drop_unroutable_metric 2025-04-14 02:06:37.665338+00:00 [info] <0.234.0> Feature flags: [x] empty_basic_get_metric 2025-04-14 02:06:37.665356+00:00 [info] <0.234.0> Feature flags: [x] implicit_default_bindings 2025-04-14 02:06:37.665407+00:00 [info] <0.234.0> Feature flags: [x] maintenance_mode_status 2025-04-14 02:06:37.665437+00:00 [info] <0.234.0> Feature flags: [x] quorum_queue 2025-04-14 02:06:37.665453+00:00 [info] <0.234.0> Feature flags: [x] stream_queue 2025-04-14 02:06:37.665468+00:00 [info] <0.234.0> Feature flags: [x] user_limits 2025-04-14 02:06:37.665521+00:00 [info] <0.234.0> Feature flags: [x] virtual_host_metadata 2025-04-14 02:06:37.665540+00:00 [info] <0.234.0> Feature flags: feature flag states written to disk: yes 2025-04-14 02:06:37.674680+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.674857+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.686913+00:00 [info] <0.234.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-04-14 02:06:37.687065+00:00 [info] <0.234.0> Successfully synced tables from a peer 2025-04-14 02:06:37.687092+00:00 [info] <0.234.0> Peer discovery backend rabbit_peer_discovery_classic_config does not support registration, skipping registration. 2025-04-14 02:06:37.687117+00:00 [info] <0.234.0> Will try to unlock with peer discovery backend rabbit_peer_discovery_classic_config 2025-04-14 02:06:37.687372+00:00 [info] <0.234.0> Running boot step database_sync defined by app rabbit 2025-04-14 02:06:37.687486+00:00 [info] <0.234.0> Running boot step feature_flags defined by app rabbit 2025-04-14 02:06:37.687621+00:00 [info] <0.234.0> Running boot step codec_correctness_check defined by app rabbit 2025-04-14 02:06:37.687645+00:00 [info] <0.234.0> Running boot step external_infrastructure defined by app rabbit 2025-04-14 02:06:37.687667+00:00 [info] <0.234.0> Running boot step rabbit_event defined by app rabbit 2025-04-14 02:06:37.687898+00:00 [info] <0.234.0> Running boot step rabbit_registry defined by app rabbit 2025-04-14 02:06:37.687977+00:00 [info] <0.234.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-04-14 02:06:37.688067+00:00 [info] <0.234.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-04-14 02:06:37.688119+00:00 [info] <0.234.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-04-14 02:06:37.688159+00:00 [info] <0.234.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-04-14 02:06:37.688219+00:00 [info] <0.234.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-04-14 02:06:37.688294+00:00 [info] <0.234.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-04-14 02:06:37.688336+00:00 [info] <0.234.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-04-14 02:06:37.688374+00:00 [info] <0.234.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-04-14 02:06:37.688424+00:00 [info] <0.234.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-04-14 02:06:37.688474+00:00 [info] <0.234.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-04-14 02:06:37.688527+00:00 [info] <0.234.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-04-14 02:06:37.688552+00:00 [info] <0.234.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-04-14 02:06:37.688600+00:00 [info] <0.234.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-04-14 02:06:37.688663+00:00 [info] <0.234.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-04-14 02:06:37.688720+00:00 [info] <0.234.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-04-14 02:06:37.688752+00:00 [info] <0.234.0> Running boot step kernel_ready defined by app rabbit 2025-04-14 02:06:37.688773+00:00 [info] <0.234.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-04-14 02:06:37.688883+00:00 [info] <0.234.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-04-14 02:06:37.689455+00:00 [info] <0.600.0> epmd monitor knows us, inter-node communication (distribution) port: 25672 2025-04-14 02:06:37.689541+00:00 [info] <0.234.0> Running boot step guid_generator defined by app rabbit 2025-04-14 02:06:37.693535+00:00 [info] <0.234.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-04-14 02:06:37.693758+00:00 [info] <0.604.0> Starting rabbit_node_monitor 2025-04-14 02:06:37.693929+00:00 [info] <0.234.0> Running boot step delegate_sup defined by app rabbit 2025-04-14 02:06:37.694296+00:00 [info] <0.234.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-04-14 02:06:37.694440+00:00 [info] <0.234.0> Running boot step core_initialized defined by app rabbit 2025-04-14 02:06:37.694472+00:00 [info] <0.234.0> Running boot step upgrade_queues defined by app rabbit 2025-04-14 02:06:37.701394+00:00 [info] <0.234.0> message_store upgrades: 1 to apply 2025-04-14 02:06:37.701510+00:00 [info] <0.234.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-04-14 02:06:37.701610+00:00 [info] <0.234.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-04-14 02:06:37.701670+00:00 [info] <0.234.0> message_store upgrades: Removing the old message store data 2025-04-14 02:06:37.701997+00:00 [info] <0.234.0> message_store upgrades: All upgrades applied successfully 2025-04-14 02:06:37.712090+00:00 [info] <0.234.0> Running boot step channel_tracking defined by app rabbit 2025-04-14 02:06:37.716332+00:00 [info] <0.234.0> Setting up a table for channel tracking on this node: 'tracked_channel_on_node_rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1' 2025-04-14 02:06:37.719844+00:00 [info] <0.234.0> Setting up a table for channel tracking on this node: 'tracked_channel_table_per_user_on_node_rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1' 2025-04-14 02:06:37.720113+00:00 [info] <0.234.0> Running boot step rabbit_channel_tracking_handler defined by app rabbit 2025-04-14 02:06:37.720187+00:00 [info] <0.234.0> Running boot step connection_tracking defined by app rabbit 2025-04-14 02:06:37.723485+00:00 [info] <0.234.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1' 2025-04-14 02:06:37.742657+00:00 [info] <0.234.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1' 2025-04-14 02:06:37.746355+00:00 [info] <0.234.0> Setting up a table for per-user connection counting on this node: 'tracked_connection_table_per_user_on_node_rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1' 2025-04-14 02:06:37.746652+00:00 [info] <0.234.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-04-14 02:06:37.746752+00:00 [info] <0.234.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-04-14 02:06:37.746826+00:00 [info] <0.234.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-04-14 02:06:37.746969+00:00 [info] <0.234.0> Running boot step rabbit_policies defined by app rabbit 2025-04-14 02:06:37.747235+00:00 [info] <0.234.0> Running boot step rabbit_policy defined by app rabbit 2025-04-14 02:06:37.747295+00:00 [info] <0.234.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-04-14 02:06:37.747354+00:00 [info] <0.234.0> Running boot step rabbit_quorum_memory_manager defined by app rabbit 2025-04-14 02:06:37.747440+00:00 [info] <0.234.0> Running boot step rabbit_stream_coordinator defined by app rabbit 2025-04-14 02:06:37.747511+00:00 [info] <0.234.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-04-14 02:06:37.747551+00:00 [info] <0.234.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-04-14 02:06:37.747587+00:00 [info] <0.234.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-04-14 02:06:37.747614+00:00 [info] <0.234.0> Management plugin: using rates mode 'basic' 2025-04-14 02:06:37.747944+00:00 [info] <0.234.0> Running boot step recovery defined by app rabbit 2025-04-14 02:06:37.748599+00:00 [info] <0.234.0> Running boot step empty_db_check defined by app rabbit 2025-04-14 02:06:37.748648+00:00 [info] <0.234.0> Will not seed default virtual host and user: have definitions to load... 2025-04-14 02:06:37.748669+00:00 [info] <0.234.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-04-14 02:06:37.748704+00:00 [info] <0.234.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-04-14 02:06:37.748909+00:00 [info] <0.234.0> Running boot step background_gc defined by app rabbit 2025-04-14 02:06:37.749087+00:00 [info] <0.234.0> Running boot step routing_ready defined by app rabbit 2025-04-14 02:06:37.749119+00:00 [info] <0.234.0> Running boot step pre_flight defined by app rabbit 2025-04-14 02:06:37.749160+00:00 [info] <0.234.0> Running boot step notify_cluster defined by app rabbit 2025-04-14 02:06:37.749187+00:00 [info] <0.234.0> Running boot step networking defined by app rabbit 2025-04-14 02:06:37.749208+00:00 [info] <0.234.0> Running boot step definition_import_worker_pool defined by app rabbit 2025-04-14 02:06:37.749255+00:00 [info] <0.302.0> Starting worker pool 'definition_import_pool' with 8 processes in it 2025-04-14 02:06:37.749713+00:00 [info] <0.234.0> Running boot step cluster_name defined by app rabbit 2025-04-14 02:06:37.749790+00:00 [info] <0.234.0> Initialising internal cluster ID to 'rabbitmq-cluster-id-k45k5Jnk0Z6VhCoAG_pggw' 2025-04-14 02:06:37.752646+00:00 [info] <0.234.0> Running boot step direct_client defined by app rabbit 2025-04-14 02:06:37.752757+00:00 [info] <0.234.0> Running boot step rabbit_maintenance_mode_state defined by app rabbit 2025-04-14 02:06:37.752786+00:00 [info] <0.234.0> Creating table rabbit_node_maintenance_states for feature flag `maintenance_mode_status` 2025-04-14 02:06:37.752926+00:00 [info] <0.234.0> Running boot step rabbit_management_load_definitions defined by app rabbitmq_management 2025-04-14 02:06:37.753201+00:00 [info] <0.234.0> Applying definitions from file at '/etc/rabbitmq/definitions.json' 2025-04-14 02:06:37.753234+00:00 [info] <0.234.0> Asked to import definitions. Acting user: rmq-internal 2025-04-14 02:06:37.753301+00:00 [info] <0.234.0> Importing concurrently 1 users... 2025-04-14 02:06:37.755807+00:00 [info] <0.661.0> Created user 'openstack' 2025-04-14 02:06:37.755869+00:00 [info] <0.661.0> Successfully set user tags for user 'openstack' to [administrator] 2025-04-14 02:06:37.755980+00:00 [info] <0.234.0> Importing concurrently 1 vhosts... 2025-04-14 02:06:37.756142+00:00 [info] <0.661.0> Adding vhost '/' (description: '', tags: []) 2025-04-14 02:06:37.775537+00:00 [info] <0.678.0> Making sure data directory '/var/lib/rabbitmq/mnesia/rabbit@cn-jenkins-deploy-platform-ansible-os-3087-1/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-04-14 02:06:37.776469+00:00 [info] <0.678.0> Setting segment_entry_count for vhost '/' with 0 queues to '2048' 2025-04-14 02:06:37.780010+00:00 [info] <0.678.0> Starting message stores for vhost '/' 2025-04-14 02:06:37.780256+00:00 [info] <0.682.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-04-14 02:06:37.781313+00:00 [info] <0.678.0> Started message store of type transient for vhost '/' 2025-04-14 02:06:37.781534+00:00 [info] <0.686.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-04-14 02:06:37.781964+00:00 [warning] <0.686.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-04-14 02:06:37.782428+00:00 [info] <0.678.0> Started message store of type persistent for vhost '/' 2025-04-14 02:06:37.782569+00:00 [info] <0.678.0> Recovering 0 queues of type rabbit_classic_queue took 5ms 2025-04-14 02:06:37.782610+00:00 [info] <0.678.0> Recovering 0 queues of type rabbit_quorum_queue took 0ms 2025-04-14 02:06:37.782633+00:00 [info] <0.678.0> Recovering 0 queues of type rabbit_stream_queue took 0ms 2025-04-14 02:06:37.783947+00:00 [info] <0.234.0> Importing concurrently 1 permissions... 2025-04-14 02:06:37.786817+00:00 [info] <0.661.0> Successfully set permissions for 'openstack' in virtual host '/' to '.*', '.*', '.*' 2025-04-14 02:06:37.792017+00:00 [info] <0.715.0> Resetting node maintenance status 2025-04-14 02:06:37.808637+00:00 [info] <0.774.0> Management plugin: HTTP (non-TLS) listener started on port 15672 2025-04-14 02:06:37.808814+00:00 [info] <0.802.0> Statistics database started. 2025-04-14 02:06:37.808907+00:00 [info] <0.801.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-04-14 02:06:37.809222+00:00 [info] <0.715.0> Ready to start client connection listeners 2025-04-14 02:06:37.810289+00:00 [info] <0.826.0> started TCP listener on 10.0.0.50:5672 2025-04-14 02:06:37.870239+00:00 [info] <0.715.0> Server startup complete; 3 plugins started. 2025-04-14 02:06:37.870239+00:00 [info] <0.715.0> * rabbitmq_management 2025-04-14 02:06:37.870239+00:00 [info] <0.715.0> * rabbitmq_web_dispatch 2025-04-14 02:06:37.870239+00:00 [info] <0.715.0> * rabbitmq_management_agent 2025-04-14 02:07:39.558334+00:00 [info] <0.908.0> accepting AMQP connection <0.908.0> (10.0.0.50:59660 -> 10.0.0.50:5672) 2025-04-14 02:07:39.559491+00:00 [info] <0.908.0> Connection <0.908.0> (10.0.0.50:59660 -> 10.0.0.50:5672) has a client-provided name: keystone-manage:261:c3b726b5-2aef-4919-a36b-16db7b90888e 2025-04-14 02:07:39.560256+00:00 [info] <0.908.0> connection <0.908.0> (10.0.0.50:59660 -> 10.0.0.50:5672 - keystone-manage:261:c3b726b5-2aef-4919-a36b-16db7b90888e): user 'openstack' authenticated and granted access to vhost '/' 2025-04-14 02:07:40.345953+00:00 [warning] <0.908.0> closing AMQP connection <0.908.0> (10.0.0.50:59660 -> 10.0.0.50:5672 - keystone-manage:261:c3b726b5-2aef-4919-a36b-16db7b90888e, vhost: '/', user: 'openstack'): 2025-04-14 02:07:40.345953+00:00 [warning] <0.908.0> client unexpectedly closed TCP connection 2025-04-14 02:07:45.684287+00:00 [info] <0.944.0> accepting AMQP connection <0.944.0> (10.0.0.50:58878 -> 10.0.0.50:5672) 2025-04-14 02:07:45.685327+00:00 [info] <0.944.0> Connection <0.944.0> (10.0.0.50:58878 -> 10.0.0.50:5672) has a client-provided name: mod_wsgi:32:f76cc29b-7ce0-401f-92ff-5355ef35fe3a 2025-04-14 02:07:45.686331+00:00 [info] <0.944.0> connection <0.944.0> (10.0.0.50:58878 -> 10.0.0.50:5672 - mod_wsgi:32:f76cc29b-7ce0-401f-92ff-5355ef35fe3a): user 'openstack' authenticated and granted access to vhost '/'