2025-02-10 00:45:23.168 [info] <0.8.0> Log file opened with Lager 2025-02-10 00:45:25.651 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 00:45:25.651 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 00:45:25.678 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 00:45:25.678 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 00:45:25.690 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2025-02-10 00:45:25.690 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 00:45:25.691 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 00:45:25.695 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 00:45:25.700 [info] <0.248.0> Enabling free disk space monitoring 2025-02-10 00:45:25.700 [info] <0.248.0> Disk free limit set to 50MB 2025-02-10 00:45:25.704 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 00:45:25.704 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 00:45:25.704 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 00:45:25.704 [info] <0.252.0> FHC read buffering: OFF 2025-02-10 00:45:25.704 [info] <0.252.0> FHC write buffering: ON 2025-02-10 00:45:25.705 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2025-02-10 00:45:25.705 [info] <0.241.0> Will use 4 processes for default worker pool 2025-02-10 00:45:25.705 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 00:45:25.705 [info] <0.240.0> Running boot step database defined by app rabbit 2025-02-10 00:45:25.705 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-02-10 00:45:25.705 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-02-10 00:45:25.705 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:45:25.705 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-02-10 00:45:25.705 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-02-10 00:45:25.705 [info] <0.240.0> Will wait for 8835 milliseconds before proceeding with registration... 2025-02-10 00:45:34.541 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1, contrail@cn-jenkins-deploy-platform-ansible-os-2705-2, contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 2025-02-10 00:45:34.541 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1, contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 2025-02-10 00:45:34.552 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:34.555 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:34.555 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2025-02-10 00:45:35.057 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:35.058 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:35.058 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2025-02-10 00:45:35.559 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:35.559 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:35.560 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 7 retries left... 2025-02-10 00:45:36.061 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:36.061 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:36.061 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 6 retries left... 2025-02-10 00:45:36.563 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:36.563 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:36.563 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 5 retries left... 2025-02-10 00:45:37.064 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:37.065 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:37.065 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 4 retries left... 2025-02-10 00:45:37.566 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:37.568 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:37.568 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 3 retries left... 2025-02-10 00:45:38.070 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:38.070 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:38.070 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 2 retries left... 2025-02-10 00:45:38.571 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:38.572 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:38.572 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 1 retries left... 2025-02-10 00:45:39.074 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-1: {error,tables_not_present} 2025-02-10 00:45:39.074 [warning] <0.240.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-2705-3: {error,tables_not_present} 2025-02-10 00:45:39.074 [error] <0.240.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 0 retries left... 2025-02-10 00:45:39.575 [warning] <0.240.0> Could not successfully contact any node of: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1,contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 (as in Erlang distribution). Starting as a blank standalone node... 2025-02-10 00:45:39.577 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:45:39.687 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:45:39.687 [info] <0.240.0> Successfully synced tables from a peer 2025-02-10 00:45:39.713 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:45:39.713 [info] <0.240.0> Successfully synced tables from a peer 2025-02-10 00:45:39.739 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:45:39.739 [info] <0.240.0> Successfully synced tables from a peer 2025-02-10 00:45:39.739 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:45:39.739 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2025-02-10 00:45:39.739 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2025-02-10 00:45:39.739 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 00:45:39.739 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 00:45:39.740 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 00:45:39.741 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 00:45:39.741 [info] <0.440.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 00:45:39.742 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2025-02-10 00:45:39.747 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 00:45:39.747 [info] <0.444.0> Starting rabbit_node_monitor 2025-02-10 00:45:39.747 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 00:45:39.748 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 00:45:39.750 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2025-02-10 00:45:39.750 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 00:45:39.771 [info] <0.240.0> message_store upgrades: 1 to apply 2025-02-10 00:45:39.771 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-10 00:45:39.771 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-10 00:45:39.772 [info] <0.240.0> message_store upgrades: Removing the old message store data 2025-02-10 00:45:39.772 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2025-02-10 00:45:39.840 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 00:45:39.840 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 00:45:39.840 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 00:45:39.840 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 00:45:39.840 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 00:45:39.841 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 00:45:39.841 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 00:45:39.841 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 00:45:39.841 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 00:45:39.841 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 00:45:39.841 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 00:45:39.841 [info] <0.240.0> Management plugin: using rates mode 'basic' 2025-02-10 00:45:39.841 [info] <0.240.0> Running boot step recovery defined by app rabbit 2025-02-10 00:45:39.842 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 00:45:39.842 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 00:45:39.842 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 00:45:39.842 [info] <0.240.0> Importing users... 2025-02-10 00:45:39.842 [info] <0.240.0> Creating user 'guest' 2025-02-10 00:45:39.869 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 00:45:39.871 [info] <0.240.0> Importing vhosts... 2025-02-10 00:45:39.872 [info] <0.240.0> Adding vhost '/' 2025-02-10 00:45:39.893 [info] <0.492.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 00:45:39.897 [info] <0.492.0> Starting message stores for vhost '/' 2025-02-10 00:45:39.897 [info] <0.496.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 00:45:39.898 [info] <0.492.0> Started message store of type transient for vhost '/' 2025-02-10 00:45:39.898 [info] <0.499.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 00:45:39.898 [warning] <0.499.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-10 00:45:39.899 [info] <0.492.0> Started message store of type persistent for vhost '/' 2025-02-10 00:45:39.900 [info] <0.240.0> Importing user permissions... 2025-02-10 00:45:39.900 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 00:45:39.903 [info] <0.240.0> Importing topic permissions... 2025-02-10 00:45:39.903 [info] <0.240.0> Importing parameters... 2025-02-10 00:45:39.903 [info] <0.240.0> Importing global parameters... 2025-02-10 00:45:39.903 [info] <0.240.0> Importing policies... 2025-02-10 00:45:39.908 [info] <0.240.0> Importing queues... 2025-02-10 00:45:39.908 [info] <0.240.0> Importing exchanges... 2025-02-10 00:45:39.908 [info] <0.240.0> Importing bindings... 2025-02-10 00:45:39.908 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 00:45:39.908 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 00:45:39.908 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 00:45:39.909 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2025-02-10 00:45:39.909 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 00:45:39.912 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:45:39.915 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:45:39.916 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2025-02-10 00:45:39.916 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2025-02-10 00:45:39.916 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 00:45:39.916 [info] <0.240.0> Running boot step networking defined by app rabbit 2025-02-10 00:45:39.917 [info] <0.545.0> started TCP listener on [::]:5673 2025-02-10 00:45:39.917 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2025-02-10 00:45:39.917 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2025-02-10 00:45:39.918 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 00:45:39.918 [info] <0.547.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 00:45:39.944 [info] <0.597.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 00:45:39.944 [info] <0.703.0> Statistics database started. 2025-02-10 00:45:39.944 [info] <0.702.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 00:45:39.945 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 00:45:40.023 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2025-02-10 00:45:47.402 [info] <0.727.0> RabbitMQ is asked to stop... 2025-02-10 00:45:47.481 [info] <0.727.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 00:45:47.482 [info] <0.727.0> Stopping application 'rabbitmq_management' 2025-02-10 00:45:47.483 [warning] <0.593.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-10 00:45:47.486 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-10 00:45:47.486 [info] <0.727.0> Stopping application 'amqp_client' 2025-02-10 00:45:47.488 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-10 00:45:47.488 [info] <0.727.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 00:45:47.490 [info] <0.727.0> Stopping application 'cowboy' 2025-02-10 00:45:47.490 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-10 00:45:47.492 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-10 00:45:47.492 [info] <0.727.0> Stopping application 'cowlib' 2025-02-10 00:45:47.492 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-10 00:45:47.492 [info] <0.727.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 00:45:47.494 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-10 00:45:47.494 [info] <0.727.0> Stopping application 'rabbit' 2025-02-10 00:45:47.494 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:45:47.494 [info] <0.545.0> stopped TCP listener on [::]:5673 2025-02-10 00:45:47.495 [info] <0.469.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' because the vhost is stopping 2025-02-10 00:45:47.495 [info] <0.499.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-10 00:45:47.509 [info] <0.499.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-10 00:45:47.510 [info] <0.496.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-10 00:45:47.514 [info] <0.496.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-10 00:45:47.517 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-10 00:45:47.517 [info] <0.727.0> Stopping application 'mnesia' 2025-02-10 00:45:47.546 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:45:47.546 [info] <0.727.0> Stopping application 'rabbit_common' 2025-02-10 00:45:47.546 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-10 00:45:47.546 [info] <0.727.0> Stopping application 'sysmon_handler' 2025-02-10 00:45:47.547 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-10 00:45:47.547 [info] <0.727.0> Stopping application 'os_mon' 2025-02-10 00:45:47.548 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-10 00:45:47.548 [info] <0.727.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 00:45:58.727 [info] <0.742.0> Resetting Rabbit forcefully 2025-02-10 00:46:00.100 [info] <0.754.0> RabbitMQ is asked to stop... 2025-02-10 00:46:00.190 [info] <0.754.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'rabbitmq_management' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'amqp_client' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'rabbit' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'mnesia' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'rabbit_common' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'sysmon_handler' 2025-02-10 00:46:00.191 [info] <0.754.0> Stopping application 'os_mon' 2025-02-10 00:46:00.191 [info] <0.754.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 00:46:00.191 [info] <0.754.0> Halting Erlang VM with the following applications: ranch ssl credentials_obfuscation public_key asn1 observer_cli jsx tools crypto stdout_formatter recon inets xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-10 00:46:05.276 [info] <0.8.0> Log file opened with Lager 2025-02-10 00:46:07.157 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 00:46:07.157 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 00:46:07.176 [info] <0.240.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 00:46:07.176 [info] <0.240.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 00:46:07.188 [info] <0.240.0> Running boot step pre_boot defined by app rabbit 2025-02-10 00:46:07.188 [info] <0.240.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 00:46:07.189 [info] <0.240.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 00:46:07.194 [info] <0.246.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 00:46:07.198 [info] <0.248.0> Enabling free disk space monitoring 2025-02-10 00:46:07.198 [info] <0.248.0> Disk free limit set to 50MB 2025-02-10 00:46:07.202 [info] <0.240.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 00:46:07.202 [info] <0.240.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 00:46:07.202 [info] <0.251.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 00:46:07.202 [info] <0.252.0> FHC read buffering: OFF 2025-02-10 00:46:07.202 [info] <0.252.0> FHC write buffering: ON 2025-02-10 00:46:07.202 [info] <0.240.0> Running boot step worker_pool defined by app rabbit 2025-02-10 00:46:07.202 [info] <0.241.0> Will use 4 processes for default worker pool 2025-02-10 00:46:07.203 [info] <0.241.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 00:46:07.203 [info] <0.240.0> Running boot step database defined by app rabbit 2025-02-10 00:46:07.203 [info] <0.240.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-02-10 00:46:07.203 [info] <0.240.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-02-10 00:46:07.203 [info] <0.240.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:46:07.203 [info] <0.240.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-02-10 00:46:07.203 [info] <0.240.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-02-10 00:46:07.203 [info] <0.240.0> Will wait for 41260 milliseconds before proceeding with registration... 2025-02-10 00:46:48.464 [info] <0.240.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1, contrail@cn-jenkins-deploy-platform-ansible-os-2705-2, contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 2025-02-10 00:46:48.464 [info] <0.240.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1, contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 2025-02-10 00:46:48.470 [info] <0.240.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' selected for auto-clustering 2025-02-10 00:46:48.497 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:46:48.497 [info] <0.240.0> Successfully synced tables from a peer 2025-02-10 00:46:48.724 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:46:48.725 [info] <0.240.0> Successfully synced tables from a peer 2025-02-10 00:46:48.759 [info] <0.240.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:46:48.759 [info] <0.240.0> Successfully synced tables from a peer 2025-02-10 00:46:48.770 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:46:48.774 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:46:48.775 [info] <0.240.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step database_sync defined by app rabbit 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step feature_flags defined by app rabbit 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 00:46:48.775 [info] <0.240.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 00:46:48.776 [info] <0.240.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 00:46:48.776 [info] <0.240.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 00:46:48.777 [info] <0.240.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 00:46:48.777 [info] <0.240.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 00:46:48.777 [info] <0.240.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 00:46:48.777 [info] <0.240.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 00:46:48.782 [info] <0.487.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 00:46:48.782 [info] <0.240.0> Running boot step guid_generator defined by app rabbit 2025-02-10 00:46:48.789 [info] <0.240.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 00:46:48.790 [info] <0.491.0> Starting rabbit_node_monitor 2025-02-10 00:46:48.790 [info] <0.240.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 00:46:48.790 [info] <0.240.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 00:46:48.790 [info] <0.240.0> Running boot step core_initialized defined by app rabbit 2025-02-10 00:46:48.791 [info] <0.240.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 00:46:48.811 [info] <0.240.0> message_store upgrades: 1 to apply 2025-02-10 00:46:48.811 [info] <0.240.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-10 00:46:48.811 [info] <0.240.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-10 00:46:48.811 [info] <0.240.0> message_store upgrades: Removing the old message store data 2025-02-10 00:46:48.812 [info] <0.240.0> message_store upgrades: All upgrades applied successfully 2025-02-10 00:46:48.834 [info] <0.240.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 00:46:48.835 [info] <0.240.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 00:46:48.835 [info] <0.240.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 00:46:48.835 [info] <0.240.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 00:46:48.835 [info] <0.240.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 00:46:48.835 [info] <0.240.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 00:46:48.836 [info] <0.240.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 00:46:48.836 [info] <0.240.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 00:46:48.836 [info] <0.240.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 00:46:48.836 [info] <0.240.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 00:46:48.836 [warning] <0.240.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 00:46:48.836 [info] <0.240.0> Management plugin: using rates mode 'basic' 2025-02-10 00:46:48.837 [info] <0.240.0> Running boot step recovery defined by app rabbit 2025-02-10 00:46:48.838 [info] <0.528.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 00:46:48.842 [info] <0.528.0> Starting message stores for vhost '/' 2025-02-10 00:46:48.842 [info] <0.532.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 00:46:48.843 [info] <0.528.0> Started message store of type transient for vhost '/' 2025-02-10 00:46:48.843 [info] <0.535.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 00:46:48.844 [warning] <0.535.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-10 00:46:48.844 [info] <0.528.0> Started message store of type persistent for vhost '/' 2025-02-10 00:46:48.845 [info] <0.240.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 00:46:48.845 [info] <0.240.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 00:46:48.845 [info] <0.240.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 00:46:48.845 [info] <0.240.0> Importing users... 2025-02-10 00:46:48.854 [info] <0.240.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 00:46:48.857 [info] <0.240.0> Importing vhosts... 2025-02-10 00:46:48.857 [info] <0.240.0> Importing user permissions... 2025-02-10 00:46:48.857 [info] <0.240.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 00:46:48.860 [info] <0.240.0> Importing topic permissions... 2025-02-10 00:46:48.860 [info] <0.240.0> Importing parameters... 2025-02-10 00:46:48.860 [info] <0.240.0> Importing global parameters... 2025-02-10 00:46:48.860 [info] <0.240.0> Importing policies... 2025-02-10 00:46:48.864 [info] <0.240.0> Importing queues... 2025-02-10 00:46:48.864 [info] <0.240.0> Importing exchanges... 2025-02-10 00:46:48.864 [info] <0.240.0> Importing bindings... 2025-02-10 00:46:48.864 [info] <0.240.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 00:46:48.864 [info] <0.240.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 00:46:48.864 [info] <0.240.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 00:46:48.864 [info] <0.240.0> Running boot step background_gc defined by app rabbit 2025-02-10 00:46:48.864 [info] <0.240.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 00:46:48.865 [info] <0.240.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:46:48.868 [info] <0.240.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:46:48.868 [info] <0.240.0> Running boot step routing_ready defined by app rabbit 2025-02-10 00:46:48.868 [info] <0.240.0> Running boot step pre_flight defined by app rabbit 2025-02-10 00:46:48.868 [info] <0.240.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 00:46:48.868 [info] <0.240.0> Running boot step networking defined by app rabbit 2025-02-10 00:46:48.869 [info] <0.491.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 00:46:48.871 [info] <0.576.0> started TCP listener on [::]:5673 2025-02-10 00:46:48.872 [info] <0.240.0> Running boot step cluster_name defined by app rabbit 2025-02-10 00:46:48.872 [info] <0.240.0> Running boot step direct_client defined by app rabbit 2025-02-10 00:46:48.872 [info] <0.240.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 00:46:48.872 [info] <0.578.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 00:46:48.887 [info] <0.491.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 00:46:48.917 [info] <0.630.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 00:46:48.917 [info] <0.736.0> Statistics database started. 2025-02-10 00:46:48.917 [info] <0.735.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 00:46:48.918 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 00:46:48.988 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-10 00:46:55.220 [info] <0.748.0> RabbitMQ is asked to stop... 2025-02-10 00:46:55.299 [info] <0.748.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 00:46:55.299 [info] <0.748.0> Stopping application 'rabbitmq_management' 2025-02-10 00:46:55.300 [warning] <0.584.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-10 00:46:55.302 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-10 00:46:55.302 [info] <0.748.0> Stopping application 'amqp_client' 2025-02-10 00:46:55.303 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-10 00:46:55.303 [info] <0.748.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 00:46:55.304 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-10 00:46:55.304 [info] <0.748.0> Stopping application 'cowboy' 2025-02-10 00:46:55.305 [info] <0.748.0> Stopping application 'cowlib' 2025-02-10 00:46:55.305 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-10 00:46:55.305 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-10 00:46:55.305 [info] <0.748.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 00:46:55.307 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-10 00:46:55.307 [info] <0.748.0> Stopping application 'rabbit' 2025-02-10 00:46:55.307 [info] <0.240.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:46:55.307 [info] <0.576.0> stopped TCP listener on [::]:5673 2025-02-10 00:46:55.307 [info] <0.516.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' because the vhost is stopping 2025-02-10 00:46:55.308 [info] <0.535.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-10 00:46:55.313 [info] <0.535.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-10 00:46:55.313 [info] <0.532.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-10 00:46:55.317 [info] <0.532.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-10 00:46:55.319 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-10 00:46:55.319 [info] <0.748.0> Stopping application 'mnesia' 2025-02-10 00:46:55.321 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:46:55.321 [info] <0.748.0> Stopping application 'rabbit_common' 2025-02-10 00:46:55.321 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-10 00:46:55.321 [info] <0.748.0> Stopping application 'sysmon_handler' 2025-02-10 00:46:55.322 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-10 00:46:55.322 [info] <0.748.0> Stopping application 'os_mon' 2025-02-10 00:46:55.323 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-10 00:46:55.323 [info] <0.748.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 00:47:04.551 [info] <0.765.0> Resetting Rabbit forcefully 2025-02-10 00:47:05.285 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:47:05.288 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:47:05.381 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:05.381 [info] <0.771.0> Successfully synced tables from a peer 2025-02-10 00:47:05.409 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:05.409 [info] <0.771.0> Successfully synced tables from a peer 2025-02-10 00:47:05.437 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2025-02-10 00:47:05.437 [info] <0.771.0> Successfully synced tables from a peer 2025-02-10 00:47:05.444 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:47:05.453 [info] <0.771.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-2705-3','contrail@cn-jenkins-deploy-platform-ansible-os-2705-1'] as disc node 2025-02-10 00:47:05.472 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:05.473 [info] <0.771.0> Successfully synced tables from a peer 2025-02-10 00:47:05.716 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:05.716 [info] <0.771.0> Successfully synced tables from a peer 2025-02-10 00:47:05.749 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:05.749 [info] <0.771.0> Successfully synced tables from a peer 2025-02-10 00:47:05.755 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:47:05.755 [error] <0.771.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': {node_not_running,'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2'} 2025-02-10 00:47:05.755 [info] <0.771.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:47:05.755 [error] <0.771.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': {node_not_running,'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2'} 2025-02-10 00:47:05.755 [info] <0.771.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:47:06.554 [info] <0.1138.0> RabbitMQ is asked to stop... 2025-02-10 00:47:06.622 [info] <0.1138.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_management_agent rabbitmq_web_dispatch rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 00:47:06.622 [info] <0.1138.0> Stopping application 'rabbitmq_management' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'amqp_client' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'rabbit' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'mnesia' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'rabbit_common' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'sysmon_handler' 2025-02-10 00:47:06.623 [info] <0.1138.0> Stopping application 'os_mon' 2025-02-10 00:47:06.623 [info] <0.1138.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 00:47:06.623 [info] <0.1138.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-10 00:47:11.656 [info] <0.8.0> Log file opened with Lager 2025-02-10 00:47:13.101 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 00:47:13.101 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 00:47:13.169 [info] <0.8.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2-upgrade-backup" 2025-02-10 00:47:13.171 [info] <0.8.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2-upgrade-backup" 2025-02-10 00:47:13.187 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 00:47:13.230 [info] <0.312.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 00:47:13.232 [info] <0.312.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 00:47:13.244 [info] <0.312.0> Running boot step pre_boot defined by app rabbit 2025-02-10 00:47:13.244 [info] <0.312.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 00:47:13.244 [info] <0.312.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 00:47:13.253 [info] <0.352.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 00:47:13.258 [info] <0.368.0> Enabling free disk space monitoring 2025-02-10 00:47:13.258 [info] <0.368.0> Disk free limit set to 50MB 2025-02-10 00:47:13.263 [info] <0.312.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 00:47:13.263 [info] <0.312.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 00:47:13.264 [info] <0.383.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 00:47:13.264 [info] <0.384.0> FHC read buffering: OFF 2025-02-10 00:47:13.264 [info] <0.384.0> FHC write buffering: ON 2025-02-10 00:47:13.264 [info] <0.312.0> Running boot step worker_pool defined by app rabbit 2025-02-10 00:47:13.264 [info] <0.313.0> Will use 4 processes for default worker pool 2025-02-10 00:47:13.264 [info] <0.313.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 00:47:13.265 [info] <0.312.0> Running boot step database defined by app rabbit 2025-02-10 00:47:13.266 [info] <0.312.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:13.268 [info] <0.312.0> Successfully synced tables from a peer 2025-02-10 00:47:13.269 [info] <0.312.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:13.269 [info] <0.312.0> Successfully synced tables from a peer 2025-02-10 00:47:13.304 [info] <0.312.0> upgrades: Mnesia backup removed 2025-02-10 00:47:13.304 [info] <0.312.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 00:47:13.304 [info] <0.312.0> Successfully synced tables from a peer 2025-02-10 00:47:13.304 [info] <0.312.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 00:47:13.405 [info] <0.312.0> Running boot step database_sync defined by app rabbit 2025-02-10 00:47:13.405 [info] <0.312.0> Running boot step feature_flags defined by app rabbit 2025-02-10 00:47:13.405 [info] <0.312.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 00:47:13.405 [info] <0.312.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 00:47:13.405 [info] <0.312.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 00:47:13.406 [info] <0.312.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 00:47:13.407 [info] <0.312.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 00:47:13.408 [info] <0.409.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 00:47:13.408 [info] <0.312.0> Running boot step guid_generator defined by app rabbit 2025-02-10 00:47:13.412 [info] <0.312.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 00:47:13.414 [info] <0.413.0> Starting rabbit_node_monitor 2025-02-10 00:47:13.414 [info] <0.312.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 00:47:13.414 [info] <0.312.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 00:47:13.414 [info] <0.312.0> Running boot step core_initialized defined by app rabbit 2025-02-10 00:47:13.415 [info] <0.312.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 00:47:13.436 [info] <0.312.0> message_store upgrades: 1 to apply 2025-02-10 00:47:13.436 [info] <0.312.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-10 00:47:13.436 [info] <0.312.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-10 00:47:13.436 [info] <0.312.0> message_store upgrades: Removing the old message store data 2025-02-10 00:47:13.437 [info] <0.312.0> message_store upgrades: All upgrades applied successfully 2025-02-10 00:47:13.463 [info] <0.312.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 00:47:13.463 [info] <0.312.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 00:47:13.463 [info] <0.312.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 00:47:13.463 [info] <0.312.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 00:47:13.463 [info] <0.312.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 00:47:13.464 [info] <0.312.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 00:47:13.464 [info] <0.312.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 00:47:13.464 [info] <0.312.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 00:47:13.464 [info] <0.312.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 00:47:13.464 [info] <0.312.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 00:47:13.464 [warning] <0.312.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 00:47:13.464 [info] <0.312.0> Management plugin: using rates mode 'basic' 2025-02-10 00:47:13.479 [info] <0.312.0> Running boot step recovery defined by app rabbit 2025-02-10 00:47:13.480 [info] <0.450.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 00:47:13.486 [info] <0.450.0> Starting message stores for vhost '/' 2025-02-10 00:47:13.486 [info] <0.454.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 00:47:13.489 [info] <0.450.0> Started message store of type transient for vhost '/' 2025-02-10 00:47:13.489 [info] <0.457.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 00:47:13.489 [warning] <0.457.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-10 00:47:13.496 [info] <0.450.0> Started message store of type persistent for vhost '/' 2025-02-10 00:47:13.497 [info] <0.450.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.476.0> 2025-02-10 00:47:13.498 [info] <0.450.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.480.0> 2025-02-10 00:47:13.498 [info] <0.450.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.484.0> 2025-02-10 00:47:13.499 [info] <0.450.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.488.0> 2025-02-10 00:47:13.499 [info] <0.450.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.492.0> 2025-02-10 00:47:13.499 [info] <0.450.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.496.0> 2025-02-10 00:47:13.500 [info] <0.450.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.500.0> 2025-02-10 00:47:13.500 [info] <0.450.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.504.0> 2025-02-10 00:47:13.500 [info] <0.450.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.508.0> 2025-02-10 00:47:13.501 [info] <0.450.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.512.0> 2025-02-10 00:47:13.501 [info] <0.450.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.516.0> 2025-02-10 00:47:13.503 [info] <0.312.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 00:47:13.506 [info] <0.312.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 00:47:13.506 [info] <0.312.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 00:47:13.506 [info] <0.312.0> Importing users... 2025-02-10 00:47:13.531 [info] <0.312.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 00:47:13.552 [info] <0.312.0> Importing vhosts... 2025-02-10 00:47:13.552 [info] <0.312.0> Importing user permissions... 2025-02-10 00:47:13.552 [info] <0.312.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 00:47:13.565 [info] <0.312.0> Importing topic permissions... 2025-02-10 00:47:13.565 [info] <0.312.0> Importing parameters... 2025-02-10 00:47:13.565 [info] <0.312.0> Importing global parameters... 2025-02-10 00:47:13.565 [info] <0.312.0> Importing policies... 2025-02-10 00:47:13.574 [info] <0.312.0> Importing queues... 2025-02-10 00:47:13.574 [info] <0.312.0> Importing exchanges... 2025-02-10 00:47:13.574 [info] <0.312.0> Importing bindings... 2025-02-10 00:47:13.574 [info] <0.312.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 00:47:13.574 [info] <0.312.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 00:47:13.574 [info] <0.312.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 00:47:13.574 [info] <0.312.0> Running boot step background_gc defined by app rabbit 2025-02-10 00:47:13.574 [info] <0.312.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 00:47:13.605 [info] <0.312.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:47:13.618 [info] <0.312.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 00:47:13.618 [info] <0.312.0> Running boot step routing_ready defined by app rabbit 2025-02-10 00:47:13.618 [info] <0.312.0> Running boot step pre_flight defined by app rabbit 2025-02-10 00:47:13.618 [info] <0.312.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 00:47:13.618 [info] <0.312.0> Running boot step networking defined by app rabbit 2025-02-10 00:47:13.618 [info] <0.413.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 00:47:13.620 [info] <0.581.0> started TCP listener on [::]:5673 2025-02-10 00:47:13.620 [info] <0.312.0> Running boot step cluster_name defined by app rabbit 2025-02-10 00:47:13.620 [info] <0.312.0> Running boot step direct_client defined by app rabbit 2025-02-10 00:47:13.620 [info] <0.312.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 00:47:13.620 [info] <0.583.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 00:47:13.638 [info] <0.413.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 00:47:13.685 [info] <0.657.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 00:47:13.685 [info] <0.763.0> Statistics database started. 2025-02-10 00:47:13.685 [info] <0.762.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 00:47:13.686 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 00:47:13.836 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-10 01:55:51.970 [info] <0.1195.0> RabbitMQ is asked to stop... 2025-02-10 01:55:52.085 [info] <0.1195.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 01:55:52.085 [info] <0.1195.0> Stopping application 'rabbitmq_management' 2025-02-10 01:55:52.087 [warning] <0.589.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-10 01:55:52.088 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-10 01:55:52.088 [info] <0.1195.0> Stopping application 'amqp_client' 2025-02-10 01:55:52.090 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-10 01:55:52.090 [info] <0.1195.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 01:55:52.091 [info] <0.1195.0> Stopping application 'cowboy' 2025-02-10 01:55:52.091 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-10 01:55:52.092 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-10 01:55:52.092 [info] <0.1195.0> Stopping application 'cowlib' 2025-02-10 01:55:52.093 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-10 01:55:52.093 [info] <0.1195.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 01:55:52.095 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-10 01:55:52.095 [info] <0.1195.0> Stopping application 'rabbit' 2025-02-10 01:55:52.095 [info] <0.312.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 01:55:52.096 [info] <0.581.0> stopped TCP listener on [::]:5673 2025-02-10 01:55:52.096 [info] <0.438.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' because the vhost is stopping 2025-02-10 01:55:52.101 [info] <0.457.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-10 01:55:52.107 [info] <0.457.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-10 01:55:52.107 [info] <0.454.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-10 01:55:52.110 [info] <0.454.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-10 01:55:52.116 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-10 01:55:52.116 [info] <0.1195.0> Stopping application 'mnesia' 2025-02-10 01:55:52.121 [info] <0.1195.0> Stopping application 'rabbit_common' 2025-02-10 01:55:52.121 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 01:55:52.121 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-10 01:55:52.121 [info] <0.1195.0> Stopping application 'sysmon_handler' 2025-02-10 01:55:52.122 [info] <0.1195.0> Stopping application 'os_mon' 2025-02-10 01:55:52.122 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-10 01:55:52.123 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-10 01:55:52.123 [info] <0.1195.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 01:55:52.124 [info] <0.1195.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli tools credentials_obfuscation crypto stdout_formatter recon inets jsx xmerl lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-10 01:56:17.661 [info] <0.8.0> Log file opened with Lager 2025-02-10 01:56:24.769 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 01:56:24.777 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 01:56:25.296 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 01:56:25.574 [info] <0.300.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 01:56:25.583 [info] <0.300.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 01:56:25.763 [info] <0.300.0> Running boot step pre_boot defined by app rabbit 2025-02-10 01:56:25.763 [info] <0.300.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 01:56:25.763 [info] <0.300.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 01:56:25.859 [info] <0.333.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 01:56:26.032 [info] <0.352.0> Enabling free disk space monitoring 2025-02-10 01:56:26.032 [info] <0.352.0> Disk free limit set to 50MB 2025-02-10 01:56:26.082 [info] <0.300.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 01:56:26.082 [info] <0.300.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 01:56:26.082 [info] <0.387.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 01:56:26.082 [info] <0.388.0> FHC read buffering: OFF 2025-02-10 01:56:26.082 [info] <0.388.0> FHC write buffering: ON 2025-02-10 01:56:26.106 [info] <0.300.0> Running boot step worker_pool defined by app rabbit 2025-02-10 01:56:26.106 [info] <0.308.0> Will use 4 processes for default worker pool 2025-02-10 01:56:26.106 [info] <0.308.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 01:56:26.107 [info] <0.300.0> Running boot step database defined by app rabbit 2025-02-10 01:56:26.134 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 01:56:26.134 [info] <0.300.0> Successfully synced tables from a peer 2025-02-10 01:56:26.174 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 01:56:26.174 [info] <0.300.0> Successfully synced tables from a peer 2025-02-10 01:56:26.458 [info] <0.300.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 01:56:26.458 [info] <0.300.0> Successfully synced tables from a peer 2025-02-10 01:56:26.458 [info] <0.300.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 01:56:26.461 [info] <0.300.0> Running boot step database_sync defined by app rabbit 2025-02-10 01:56:26.461 [info] <0.300.0> Running boot step feature_flags defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 01:56:26.462 [info] <0.300.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 01:56:26.463 [info] <0.300.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 01:56:26.466 [info] <0.424.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 01:56:26.466 [info] <0.300.0> Running boot step guid_generator defined by app rabbit 2025-02-10 01:56:26.509 [info] <0.300.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 01:56:26.519 [info] <0.428.0> Starting rabbit_node_monitor 2025-02-10 01:56:26.519 [info] <0.300.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 01:56:26.520 [info] <0.300.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 01:56:26.520 [info] <0.300.0> Running boot step core_initialized defined by app rabbit 2025-02-10 01:56:26.520 [info] <0.300.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 01:56:26.850 [info] <0.300.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 01:56:26.850 [info] <0.300.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 01:56:26.851 [info] <0.300.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 01:56:26.851 [info] <0.300.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 01:56:26.851 [info] <0.300.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 01:56:26.855 [info] <0.300.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 01:56:26.881 [info] <0.300.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 01:56:26.886 [info] <0.300.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 01:56:26.887 [info] <0.300.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 01:56:26.892 [info] <0.300.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 01:56:26.894 [warning] <0.300.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 01:56:26.894 [info] <0.300.0> Management plugin: using rates mode 'basic' 2025-02-10 01:56:26.928 [info] <0.300.0> Running boot step recovery defined by app rabbit 2025-02-10 01:56:27.060 [info] <0.467.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 01:56:27.115 [info] <0.467.0> Starting message stores for vhost '/' 2025-02-10 01:56:27.115 [info] <0.471.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 01:56:27.141 [info] <0.467.0> Started message store of type transient for vhost '/' 2025-02-10 01:56:27.141 [info] <0.474.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 01:56:27.180 [info] <0.467.0> Started message store of type persistent for vhost '/' 2025-02-10 01:56:27.182 [info] <0.467.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.493.0> 2025-02-10 01:56:27.182 [info] <0.467.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.497.0> 2025-02-10 01:56:27.182 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.501.0> 2025-02-10 01:56:27.183 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.505.0> 2025-02-10 01:56:27.183 [info] <0.467.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.509.0> 2025-02-10 01:56:27.183 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.513.0> 2025-02-10 01:56:27.183 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.517.0> 2025-02-10 01:56:27.184 [info] <0.467.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.521.0> 2025-02-10 01:56:27.184 [info] <0.467.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.525.0> 2025-02-10 01:56:27.184 [info] <0.467.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.529.0> 2025-02-10 01:56:27.185 [info] <0.467.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.533.0> 2025-02-10 01:56:27.185 [info] <0.467.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.537.0> 2025-02-10 01:56:27.186 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.542.0> 2025-02-10 01:56:27.186 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.546.0> 2025-02-10 01:56:27.186 [info] <0.467.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.550.0> 2025-02-10 01:56:27.186 [info] <0.467.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.554.0> 2025-02-10 01:56:27.186 [info] <0.467.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.558.0> 2025-02-10 01:56:27.187 [info] <0.467.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.562.0> 2025-02-10 01:56:27.187 [info] <0.467.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.566.0> 2025-02-10 01:56:27.187 [info] <0.467.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.570.0> 2025-02-10 01:56:27.187 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.574.0> 2025-02-10 01:56:27.187 [info] <0.467.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.578.0> 2025-02-10 01:56:27.188 [info] <0.467.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.582.0> 2025-02-10 01:56:27.188 [info] <0.467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.586.0> 2025-02-10 01:56:27.188 [info] <0.467.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.590.0> 2025-02-10 01:56:27.188 [info] <0.467.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.594.0> 2025-02-10 01:56:27.189 [info] <0.467.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.598.0> 2025-02-10 01:56:27.204 [info] <0.300.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 01:56:27.206 [info] <0.300.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 01:56:27.206 [info] <0.300.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 01:56:27.206 [info] <0.300.0> Importing users... 2025-02-10 01:56:27.298 [info] <0.300.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 01:56:27.409 [info] <0.428.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 01:56:27.514 [info] <0.300.0> Importing vhosts... 2025-02-10 01:56:27.514 [info] <0.300.0> Importing user permissions... 2025-02-10 01:56:27.514 [info] <0.300.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 01:56:27.897 [info] <0.300.0> Importing topic permissions... 2025-02-10 01:56:27.897 [info] <0.300.0> Importing parameters... 2025-02-10 01:56:27.897 [info] <0.300.0> Importing global parameters... 2025-02-10 01:56:27.897 [info] <0.300.0> Importing policies... 2025-02-10 01:56:28.009 [info] <0.300.0> Importing queues... 2025-02-10 01:56:28.009 [info] <0.300.0> Importing exchanges... 2025-02-10 01:56:28.009 [info] <0.300.0> Importing bindings... 2025-02-10 01:56:28.009 [info] <0.300.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 01:56:28.009 [info] <0.300.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 01:56:28.010 [info] <0.300.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 01:56:28.014 [info] <0.300.0> Running boot step background_gc defined by app rabbit 2025-02-10 01:56:28.014 [info] <0.300.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 01:56:28.025 [info] <0.300.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 01:56:28.029 [info] <0.300.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 01:56:28.030 [info] <0.300.0> Running boot step routing_ready defined by app rabbit 2025-02-10 01:56:28.030 [info] <0.300.0> Running boot step pre_flight defined by app rabbit 2025-02-10 01:56:28.030 [info] <0.300.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 01:56:28.030 [info] <0.300.0> Running boot step networking defined by app rabbit 2025-02-10 01:56:28.032 [info] <0.428.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 01:56:28.032 [info] <0.707.0> started TCP listener on [::]:5673 2025-02-10 01:56:28.033 [info] <0.300.0> Running boot step cluster_name defined by app rabbit 2025-02-10 01:56:28.033 [info] <0.300.0> Running boot step direct_client defined by app rabbit 2025-02-10 01:56:28.033 [info] <0.300.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 01:56:28.033 [info] <0.709.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 01:56:28.127 [info] <0.428.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 01:56:28.357 [info] <0.787.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 01:56:28.357 [info] <0.919.0> Statistics database started. 2025-02-10 01:56:28.357 [info] <0.918.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 01:56:28.357 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 01:56:28.714 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2025-02-10 01:56:38.561 [info] <0.428.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' down 2025-02-10 01:56:38.570 [info] <0.428.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 listeners: the node is already back 2025-02-10 01:56:38.628 [info] <0.590.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.631 [info] <0.949.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.631 [info] <0.533.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.632 [info] <0.1014.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.650 [info] <0.521.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.650 [info] <0.978.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.650 [info] <0.558.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.650 [info] <0.578.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.654 [info] <0.554.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:38.654 [info] <0.990.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 01:56:39.658 [info] <0.428.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' down: connection_closed 2025-02-10 01:56:40.719 [info] <0.1154.0> RabbitMQ is asked to stop... 2025-02-10 01:56:41.019 [info] <0.1154.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 01:56:41.019 [info] <0.1154.0> Stopping application 'rabbitmq_management' 2025-02-10 01:56:41.022 [warning] <0.783.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-10 01:56:41.028 [info] <0.1154.0> Stopping application 'amqp_client' 2025-02-10 01:56:41.029 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-10 01:56:41.031 [info] <0.1154.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 01:56:41.031 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-10 01:56:41.035 [info] <0.1154.0> Stopping application 'cowboy' 2025-02-10 01:56:41.035 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-10 01:56:41.036 [info] <0.1154.0> Stopping application 'cowlib' 2025-02-10 01:56:41.036 [info] <0.1154.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 01:56:41.036 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-10 01:56:41.037 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-10 01:56:41.042 [info] <0.1154.0> Stopping application 'rabbit' 2025-02-10 01:56:41.042 [info] <0.300.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 01:56:41.042 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-10 01:56:41.043 [info] <0.707.0> stopped TCP listener on [::]:5673 2025-02-10 01:56:41.043 [info] <0.455.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' because the vhost is stopping 2025-02-10 01:56:41.045 [info] <0.474.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-10 01:56:41.067 [info] <0.474.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-10 01:56:41.067 [info] <0.471.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-10 01:56:41.095 [info] <0.471.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-10 01:56:41.112 [info] <0.1154.0> Stopping application 'mnesia' 2025-02-10 01:56:41.112 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-10 01:56:41.120 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 01:56:41.120 [info] <0.1154.0> Stopping application 'rabbit_common' 2025-02-10 01:56:41.125 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-10 01:56:41.125 [info] <0.1154.0> Stopping application 'sysmon_handler' 2025-02-10 01:56:41.127 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-10 01:56:41.127 [info] <0.1154.0> Stopping application 'os_mon' 2025-02-10 01:56:41.131 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-10 01:56:41.131 [info] <0.1154.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 01:56:41.135 [info] <0.1154.0> Halting Erlang VM with the following applications: jsx ranch ssl public_key asn1 observer_cli xmerl tools credentials_obfuscation crypto stdout_formatter recon inets lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-10 01:56:50.687 [info] <0.8.0> Log file opened with Lager 2025-02-10 01:56:53.842 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 01:56:53.843 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 01:56:53.994 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 01:56:54.084 [info] <0.304.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 01:56:54.086 [info] <0.304.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 01:56:54.124 [info] <0.304.0> Running boot step pre_boot defined by app rabbit 2025-02-10 01:56:54.124 [info] <0.304.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 01:56:54.128 [info] <0.304.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 01:56:54.142 [info] <0.331.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 01:56:54.155 [info] <0.341.0> Enabling free disk space monitoring 2025-02-10 01:56:54.155 [info] <0.341.0> Disk free limit set to 50MB 2025-02-10 01:56:54.169 [info] <0.304.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 01:56:54.169 [info] <0.304.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 01:56:54.170 [info] <0.364.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 01:56:54.170 [info] <0.365.0> FHC read buffering: OFF 2025-02-10 01:56:54.170 [info] <0.365.0> FHC write buffering: ON 2025-02-10 01:56:54.170 [info] <0.304.0> Running boot step worker_pool defined by app rabbit 2025-02-10 01:56:54.171 [info] <0.305.0> Will use 4 processes for default worker pool 2025-02-10 01:56:54.171 [info] <0.305.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 01:56:54.171 [info] <0.304.0> Running boot step database defined by app rabbit 2025-02-10 01:56:54.218 [info] <0.304.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 01:56:54.219 [info] <0.304.0> Successfully synced tables from a peer 2025-02-10 01:56:54.221 [info] <0.304.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 01:56:54.221 [info] <0.304.0> Successfully synced tables from a peer 2025-02-10 01:56:54.302 [info] <0.304.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 01:56:54.302 [info] <0.304.0> Successfully synced tables from a peer 2025-02-10 01:56:54.302 [info] <0.304.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step database_sync defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step feature_flags defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 01:56:54.302 [info] <0.304.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 01:56:54.303 [info] <0.304.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 01:56:54.304 [info] <0.304.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 01:56:54.304 [info] <0.304.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 01:56:54.304 [info] <0.304.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 01:56:54.309 [info] <0.413.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 01:56:54.309 [info] <0.304.0> Running boot step guid_generator defined by app rabbit 2025-02-10 01:56:54.313 [info] <0.304.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 01:56:54.314 [info] <0.417.0> Starting rabbit_node_monitor 2025-02-10 01:56:54.314 [info] <0.304.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 01:56:54.315 [info] <0.304.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 01:56:54.315 [info] <0.304.0> Running boot step core_initialized defined by app rabbit 2025-02-10 01:56:54.315 [info] <0.304.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 01:56:54.379 [info] <0.304.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 01:56:54.379 [info] <0.304.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 01:56:54.379 [info] <0.304.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 01:56:54.379 [info] <0.304.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 01:56:54.379 [info] <0.304.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 01:56:54.380 [info] <0.304.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 01:56:54.380 [info] <0.304.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 01:56:54.380 [info] <0.304.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 01:56:54.380 [info] <0.304.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 01:56:54.380 [info] <0.304.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 01:56:54.380 [warning] <0.304.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 01:56:54.380 [info] <0.304.0> Management plugin: using rates mode 'basic' 2025-02-10 01:56:54.384 [info] <0.304.0> Running boot step recovery defined by app rabbit 2025-02-10 01:56:54.385 [info] <0.454.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 01:56:54.393 [info] <0.454.0> Starting message stores for vhost '/' 2025-02-10 01:56:54.394 [info] <0.458.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 01:56:54.403 [info] <0.454.0> Started message store of type transient for vhost '/' 2025-02-10 01:56:54.403 [info] <0.461.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 01:56:54.404 [info] <0.454.0> Started message store of type persistent for vhost '/' 2025-02-10 01:56:54.405 [info] <0.454.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.480.0> 2025-02-10 01:56:54.406 [info] <0.454.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.484.0> 2025-02-10 01:56:54.406 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.488.0> 2025-02-10 01:56:54.410 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.492.0> 2025-02-10 01:56:54.411 [info] <0.454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.496.0> 2025-02-10 01:56:54.411 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.500.0> 2025-02-10 01:56:54.411 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.504.0> 2025-02-10 01:56:54.411 [info] <0.454.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.508.0> 2025-02-10 01:56:54.411 [info] <0.454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.512.0> 2025-02-10 01:56:54.411 [info] <0.454.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.516.0> 2025-02-10 01:56:54.412 [info] <0.454.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.520.0> 2025-02-10 01:56:54.412 [info] <0.454.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.524.0> 2025-02-10 01:56:54.412 [info] <0.454.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.528.0> 2025-02-10 01:56:54.412 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.532.0> 2025-02-10 01:56:54.412 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.536.0> 2025-02-10 01:56:54.413 [info] <0.454.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.540.0> 2025-02-10 01:56:54.413 [info] <0.454.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.544.0> 2025-02-10 01:56:54.413 [info] <0.454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.548.0> 2025-02-10 01:56:54.413 [info] <0.454.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.552.0> 2025-02-10 01:56:54.414 [info] <0.454.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.556.0> 2025-02-10 01:56:54.414 [info] <0.454.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.560.0> 2025-02-10 01:56:54.414 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.564.0> 2025-02-10 01:56:54.415 [info] <0.454.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.568.0> 2025-02-10 01:56:54.415 [info] <0.454.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.572.0> 2025-02-10 01:56:54.415 [info] <0.454.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.578.0> 2025-02-10 01:56:54.416 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.583.0> 2025-02-10 01:56:54.416 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.587.0> 2025-02-10 01:56:54.417 [info] <0.454.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.592.0> 2025-02-10 01:56:54.417 [info] <0.454.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.596.0> 2025-02-10 01:56:54.417 [info] <0.454.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.600.0> 2025-02-10 01:56:54.420 [info] <0.304.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 01:56:54.421 [info] <0.304.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 01:56:54.421 [info] <0.304.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 01:56:54.421 [info] <0.304.0> Importing users... 2025-02-10 01:56:54.445 [info] <0.304.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 01:56:54.496 [info] <0.304.0> Importing vhosts... 2025-02-10 01:56:54.496 [info] <0.304.0> Importing user permissions... 2025-02-10 01:56:54.496 [info] <0.304.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 01:56:54.527 [info] <0.304.0> Importing topic permissions... 2025-02-10 01:56:54.527 [info] <0.304.0> Importing parameters... 2025-02-10 01:56:54.527 [info] <0.304.0> Importing global parameters... 2025-02-10 01:56:54.527 [info] <0.304.0> Importing policies... 2025-02-10 01:56:54.552 [info] <0.304.0> Importing queues... 2025-02-10 01:56:54.552 [info] <0.304.0> Importing exchanges... 2025-02-10 01:56:54.552 [info] <0.304.0> Importing bindings... 2025-02-10 01:56:54.552 [info] <0.304.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 01:56:54.552 [info] <0.304.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 01:56:54.552 [info] <0.304.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 01:56:54.552 [info] <0.304.0> Running boot step background_gc defined by app rabbit 2025-02-10 01:56:54.552 [info] <0.304.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 01:56:54.553 [info] <0.304.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 01:56:54.558 [info] <0.304.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 01:56:54.558 [info] <0.304.0> Running boot step routing_ready defined by app rabbit 2025-02-10 01:56:54.558 [info] <0.304.0> Running boot step pre_flight defined by app rabbit 2025-02-10 01:56:54.558 [info] <0.304.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 01:56:54.558 [info] <0.304.0> Running boot step networking defined by app rabbit 2025-02-10 01:56:54.561 [info] <0.712.0> started TCP listener on [::]:5673 2025-02-10 01:56:54.561 [info] <0.304.0> Running boot step cluster_name defined by app rabbit 2025-02-10 01:56:54.561 [info] <0.304.0> Running boot step direct_client defined by app rabbit 2025-02-10 01:56:54.561 [info] <0.304.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 01:56:54.561 [info] <0.714.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 01:56:54.565 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 01:56:54.647 [info] <0.765.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 01:56:54.647 [info] <0.901.0> Statistics database started. 2025-02-10 01:56:54.647 [info] <0.900.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 01:56:54.647 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 01:56:55.106 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-10 01:56:59.725 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 02:03:15.970 [info] <0.1690.0> accepting AMQP connection <0.1690.0> (10.0.0.30:53766 -> 10.0.0.12:5673) 2025-02-10 02:03:15.970 [info] <0.1687.0> accepting AMQP connection <0.1687.0> (10.0.0.17:57028 -> 10.0.0.12:5673) 2025-02-10 02:03:15.970 [info] <0.1693.0> accepting AMQP connection <0.1693.0> (10.0.0.30:53752 -> 10.0.0.12:5673) 2025-02-10 02:03:15.971 [info] <0.1696.0> accepting AMQP connection <0.1696.0> (10.0.0.17:57008 -> 10.0.0.12:5673) 2025-02-10 02:03:15.971 [info] <0.1699.0> accepting AMQP connection <0.1699.0> (10.0.0.12:40168 -> 10.0.0.12:5673) 2025-02-10 02:03:15.971 [info] <0.1702.0> accepting AMQP connection <0.1702.0> (10.0.0.12:40182 -> 10.0.0.12:5673) 2025-02-10 02:03:15.971 [info] <0.1705.0> accepting AMQP connection <0.1705.0> (10.0.0.12:40186 -> 10.0.0.12:5673) 2025-02-10 02:03:15.972 [info] <0.1708.0> accepting AMQP connection <0.1708.0> (10.0.0.12:40202 -> 10.0.0.12:5673) 2025-02-10 02:03:15.974 [info] <0.1705.0> connection <0.1705.0> (10.0.0.12:40186 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.974 [info] <0.1702.0> connection <0.1702.0> (10.0.0.12:40182 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.974 [info] <0.1687.0> connection <0.1687.0> (10.0.0.17:57028 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.975 [info] <0.1720.0> accepting AMQP connection <0.1720.0> (10.0.0.30:53764 -> 10.0.0.12:5673) 2025-02-10 02:03:15.975 [info] <0.1723.0> accepting AMQP connection <0.1723.0> (10.0.0.12:40212 -> 10.0.0.12:5673) 2025-02-10 02:03:15.976 [info] <0.1726.0> accepting AMQP connection <0.1726.0> (10.0.0.12:40216 -> 10.0.0.12:5673) 2025-02-10 02:03:15.976 [info] <0.1729.0> accepting AMQP connection <0.1729.0> (10.0.0.12:40230 -> 10.0.0.12:5673) 2025-02-10 02:03:15.977 [info] <0.1732.0> accepting AMQP connection <0.1732.0> (10.0.0.17:57040 -> 10.0.0.12:5673) 2025-02-10 02:03:15.977 [info] <0.1735.0> accepting AMQP connection <0.1735.0> (10.0.0.30:53780 -> 10.0.0.12:5673) 2025-02-10 02:03:15.978 [info] <0.1738.0> accepting AMQP connection <0.1738.0> (10.0.0.30:53786 -> 10.0.0.12:5673) 2025-02-10 02:03:15.978 [info] <0.1741.0> accepting AMQP connection <0.1741.0> (10.0.0.30:53802 -> 10.0.0.12:5673) 2025-02-10 02:03:15.978 [info] <0.1744.0> accepting AMQP connection <0.1744.0> (10.0.0.17:57054 -> 10.0.0.12:5673) 2025-02-10 02:03:15.978 [info] <0.1747.0> accepting AMQP connection <0.1747.0> (10.0.0.30:53812 -> 10.0.0.12:5673) 2025-02-10 02:03:15.979 [info] <0.1750.0> accepting AMQP connection <0.1750.0> (10.0.0.17:57066 -> 10.0.0.12:5673) 2025-02-10 02:03:15.979 [info] <0.1753.0> accepting AMQP connection <0.1753.0> (10.0.0.12:40238 -> 10.0.0.12:5673) 2025-02-10 02:03:15.979 [info] <0.1756.0> accepting AMQP connection <0.1756.0> (10.0.0.12:40242 -> 10.0.0.12:5673) 2025-02-10 02:03:15.980 [info] <0.1717.0> accepting AMQP connection <0.1717.0> (10.0.0.17:57016 -> 10.0.0.12:5673) 2025-02-10 02:03:15.981 [info] <0.1768.0> accepting AMQP connection <0.1768.0> (10.0.0.12:40250 -> 10.0.0.12:5673) 2025-02-10 02:03:15.981 [info] <0.1696.0> connection <0.1696.0> (10.0.0.17:57008 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.983 [info] <0.1699.0> connection <0.1699.0> (10.0.0.12:40168 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.984 [info] <0.1708.0> connection <0.1708.0> (10.0.0.12:40202 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.984 [info] <0.1747.0> connection <0.1747.0> (10.0.0.30:53812 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.985 [info] <0.1690.0> connection <0.1690.0> (10.0.0.30:53766 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.986 [info] <0.1753.0> connection <0.1753.0> (10.0.0.12:40238 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.987 [info] <0.1738.0> connection <0.1738.0> (10.0.0.30:53786 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.989 [info] <0.1732.0> connection <0.1732.0> (10.0.0.17:57040 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.989 [info] <0.1693.0> connection <0.1693.0> (10.0.0.30:53752 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.989 [info] <0.1717.0> connection <0.1717.0> (10.0.0.17:57016 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.990 [info] <0.1726.0> connection <0.1726.0> (10.0.0.12:40216 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.994 [info] <0.1741.0> connection <0.1741.0> (10.0.0.30:53802 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.994 [info] <0.1720.0> connection <0.1720.0> (10.0.0.30:53764 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.994 [info] <0.1744.0> connection <0.1744.0> (10.0.0.17:57054 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.995 [info] <0.1756.0> connection <0.1756.0> (10.0.0.12:40242 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.995 [info] <0.1723.0> connection <0.1723.0> (10.0.0.12:40212 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.997 [info] <0.1750.0> connection <0.1750.0> (10.0.0.17:57066 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.997 [info] <0.1735.0> connection <0.1735.0> (10.0.0.30:53780 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.998 [info] <0.1768.0> connection <0.1768.0> (10.0.0.12:40250 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:15.999 [info] <0.1729.0> connection <0.1729.0> (10.0.0.12:40230 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:16.106 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' down 2025-02-10 02:03:16.107 [info] <0.1914.0> accepting AMQP connection <0.1914.0> (10.0.0.12:40262 -> 10.0.0.12:5673) 2025-02-10 02:03:16.107 [info] <0.1917.0> accepting AMQP connection <0.1917.0> (10.0.0.12:40272 -> 10.0.0.12:5673) 2025-02-10 02:03:16.107 [info] <0.1921.0> accepting AMQP connection <0.1921.0> (10.0.0.30:53816 -> 10.0.0.12:5673) 2025-02-10 02:03:16.109 [info] <0.1914.0> connection <0.1914.0> (10.0.0.12:40262 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:16.109 [info] <0.1921.0> connection <0.1921.0> (10.0.0.30:53816 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:16.110 [info] <0.1917.0> connection <0.1917.0> (10.0.0.12:40272 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:16.115 [info] <0.417.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2705-1 listeners: the node is already back 2025-02-10 02:03:16.213 [info] <0.1515.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.214 [info] <0.1073.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.233 [info] <0.528.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.233 [info] <0.528.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.234 [info] <0.528.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:16.234 [info] <0.528.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:16.241 [info] <0.1672.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.241 [info] <0.1527.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.242 [info] <0.1648.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.242 [info] <0.520.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.242 [info] <0.520.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.243 [info] <0.520.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:16.243 [info] <0.520.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:16.257 [info] <0.1576.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.257 [info] <0.1503.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.257 [info] <0.1949.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3': <5876.1770.0> 2025-02-10 02:03:16.265 [info] <0.552.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.265 [info] <0.2078.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:16.265 [info] <0.552.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:16.265 [info] <0.552.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:16.266 [info] <0.516.0> Mirrored queue 'job_request_consumer' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.266 [info] <0.1479.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.266 [info] <0.961.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.266 [info] <0.516.0> Mirrored queue 'job_request_consumer' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:16.266 [info] <0.2112.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:16.266 [info] <0.516.0> Mirrored queue 'job_request_consumer' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:16.266 [info] <0.961.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:16.267 [info] <0.961.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:16.267 [info] <0.2091.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:16.267 [info] <0.2118.0> Mirrored queue 'job_request_consumer' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:16.267 [info] <0.2119.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:16.268 [info] <0.1445.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.268 [info] <0.1457.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.268 [info] <0.1952.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3': <5876.1807.0> 2025-02-10 02:03:16.269 [info] <0.1468.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:03:16.272 [info] <0.1955.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3': <5876.1830.0> 2025-02-10 02:03:16.273 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.273 [info] <0.596.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Promoting slave to master 2025-02-10 02:03:16.274 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Synchronising: 91 messages to synchronise 2025-02-10 02:03:16.274 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:16.274 [info] <0.596.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:16.274 [info] <0.417.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' down: connection_closed 2025-02-10 02:03:17.169 [warning] lager_file_backend dropped 12 messages in the last second that exceeded the limit of 50 messages/sec 2025-02-10 02:03:22.562 [info] <0.2189.0> accepting AMQP connection <0.2189.0> (10.0.0.30:55752 -> 10.0.0.12:5673) 2025-02-10 02:03:22.564 [info] <0.2189.0> connection <0.2189.0> (10.0.0.30:55752 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:22.580 [info] <0.2198.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3': <5876.1881.0> 2025-02-10 02:03:22.583 [info] <0.2198.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:22.583 [info] <0.2198.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:22.585 [info] <0.2205.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:22.588 [info] <0.2209.0> accepting AMQP connection <0.2209.0> (10.0.0.30:55762 -> 10.0.0.12:5673) 2025-02-10 02:03:22.590 [info] <0.2209.0> connection <0.2209.0> (10.0.0.30:55762 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:22.601 [info] <0.2189.0> closing AMQP connection <0.2189.0> (10.0.0.30:55752 -> 10.0.0.12:5673, vhost: '/', user: 'guest') 2025-02-10 02:03:22.602 [info] <0.2209.0> closing AMQP connection <0.2209.0> (10.0.0.30:55762 -> 10.0.0.12:5673, vhost: '/', user: 'guest') 2025-02-10 02:03:22.925 [info] <0.2224.0> accepting AMQP connection <0.2224.0> (10.0.0.17:57070 -> 10.0.0.12:5673) 2025-02-10 02:03:22.927 [info] <0.2224.0> connection <0.2224.0> (10.0.0.17:57070 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:22.941 [info] <0.2233.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3': <5876.1893.0> 2025-02-10 02:03:22.943 [info] <0.2233.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:03:22.943 [info] <0.2233.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:03:22.944 [info] <0.2240.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:03:22.959 [info] <0.2244.0> accepting AMQP connection <0.2244.0> (10.0.0.17:57082 -> 10.0.0.12:5673) 2025-02-10 02:03:22.961 [info] <0.2244.0> connection <0.2244.0> (10.0.0.17:57082 -> 10.0.0.12:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-10 02:03:22.971 [info] <0.2224.0> closing AMQP connection <0.2224.0> (10.0.0.17:57070 -> 10.0.0.12:5673, vhost: '/', user: 'guest') 2025-02-10 02:03:22.971 [info] <0.2244.0> closing AMQP connection <0.2244.0> (10.0.0.17:57082 -> 10.0.0.12:5673, vhost: '/', user: 'guest') 2025-02-10 02:03:46.354 [info] <0.417.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 02:04:02.509 [info] <0.1952.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.509 [info] <0.1952.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.511 [info] <0.516.0> Mirrored queue 'job_request_consumer' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.511 [info] <0.516.0> Mirrored queue 'job_request_consumer' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.513 [info] <0.520.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.514 [info] <0.520.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.520 [info] <0.1955.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.520 [info] <0.1955.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.520 [info] <0.528.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.520 [info] <0.961.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.520 [info] <0.528.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.520 [info] <0.961.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.523 [info] <0.1949.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.523 [info] <0.1949.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.524 [info] <0.2415.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.529 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Synchronising: 91 messages to synchronise 2025-02-10 02:04:02.529 [info] <0.552.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.529 [info] <0.552.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.529 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.530 [info] <0.2427.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2705-1'] to sync 2025-02-10 02:04:02.531 [info] <0.2419.0> Mirrored queue 'job_request_consumer' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.531 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Synchronising: complete 2025-02-10 02:04:02.540 [info] <0.2421.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.564 [info] <0.2423.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.565 [info] <0.2422.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.565 [info] <0.2424.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.565 [info] <0.596.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-10 02:04:02.565 [info] <0.596.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Synchronising: batch size: 5 2025-02-10 02:04:02.567 [info] <0.2425.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.584 [info] <0.2426.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.586 [info] <0.2428.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Synchronising: all slaves already synced 2025-02-10 02:04:02.630 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 02:04:44.463 [info] <0.2466.0> RabbitMQ is asked to stop... 2025-02-10 02:04:44.515 [info] <0.2466.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 02:04:44.515 [info] <0.2466.0> Stopping application 'rabbitmq_management' 2025-02-10 02:04:44.517 [warning] <0.720.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-10 02:04:44.519 [info] <0.2466.0> Stopping application 'amqp_client' 2025-02-10 02:04:44.519 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-10 02:04:44.521 [info] <0.2466.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 02:04:44.521 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-10 02:04:44.522 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-10 02:04:44.522 [info] <0.2466.0> Stopping application 'cowboy' 2025-02-10 02:04:44.524 [info] <0.2466.0> Stopping application 'cowlib' 2025-02-10 02:04:44.524 [info] <0.2466.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 02:04:44.524 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-10 02:04:44.524 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-10 02:04:44.525 [info] <0.2466.0> Stopping application 'rabbit' 2025-02-10 02:04:44.525 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-10 02:04:44.525 [info] <0.304.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 02:04:44.526 [info] <0.712.0> stopped TCP listener on [::]:5673 2025-02-10 02:04:44.526 [error] <0.1693.0> Error on AMQP connection <0.1693.0> (10.0.0.30:53752 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1741.0> Error on AMQP connection <0.1741.0> (10.0.0.30:53802 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1921.0> Error on AMQP connection <0.1921.0> (10.0.0.30:53816 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1917.0> Error on AMQP connection <0.1917.0> (10.0.0.12:40272 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1914.0> Error on AMQP connection <0.1914.0> (10.0.0.12:40262 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1717.0> Error on AMQP connection <0.1717.0> (10.0.0.17:57016 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1735.0> Error on AMQP connection <0.1735.0> (10.0.0.30:53780 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1753.0> Error on AMQP connection <0.1753.0> (10.0.0.12:40238 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1732.0> Error on AMQP connection <0.1732.0> (10.0.0.17:57040 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1690.0> Error on AMQP connection <0.1690.0> (10.0.0.30:53766 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1705.0> Error on AMQP connection <0.1705.0> (10.0.0.12:40186 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1726.0> Error on AMQP connection <0.1726.0> (10.0.0.12:40216 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1744.0> Error on AMQP connection <0.1744.0> (10.0.0.17:57054 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1696.0> Error on AMQP connection <0.1696.0> (10.0.0.17:57008 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1720.0> Error on AMQP connection <0.1720.0> (10.0.0.30:53764 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1756.0> Error on AMQP connection <0.1756.0> (10.0.0.12:40242 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1687.0> Error on AMQP connection <0.1687.0> (10.0.0.17:57028 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1729.0> Error on AMQP connection <0.1729.0> (10.0.0.12:40230 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1708.0> Error on AMQP connection <0.1708.0> (10.0.0.12:40202 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1768.0> Error on AMQP connection <0.1768.0> (10.0.0.12:40250 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1747.0> Error on AMQP connection <0.1747.0> (10.0.0.30:53812 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1702.0> Error on AMQP connection <0.1702.0> (10.0.0.12:40182 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.526 [error] <0.1699.0> Error on AMQP connection <0.1699.0> (10.0.0.12:40168 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1723.0> Error on AMQP connection <0.1723.0> (10.0.0.12:40212 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1738.0> Error on AMQP connection <0.1738.0> (10.0.0.30:53786 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:04:44.527 [error] <0.1750.0> Error on AMQP connection <0.1750.0> (10.0.0.17:57066 -> 10.0.0.12:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-10 02:05:18.959 [info] <0.8.0> Log file opened with Lager 2025-02-10 02:05:21.875 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 02:05:21.875 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 02:05:21.952 [info] <0.247.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 02:05:21.953 [info] <0.247.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 02:05:21.965 [info] <0.247.0> Running boot step pre_boot defined by app rabbit 2025-02-10 02:05:21.965 [info] <0.247.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 02:05:21.966 [info] <0.247.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 02:05:21.978 [info] <0.253.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 02:05:21.984 [info] <0.255.0> Enabling free disk space monitoring 2025-02-10 02:05:21.984 [info] <0.255.0> Disk free limit set to 50MB 2025-02-10 02:05:21.998 [info] <0.247.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 02:05:21.998 [info] <0.247.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 02:05:21.998 [info] <0.258.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 02:05:21.998 [info] <0.259.0> FHC read buffering: OFF 2025-02-10 02:05:21.998 [info] <0.259.0> FHC write buffering: ON 2025-02-10 02:05:22.000 [info] <0.247.0> Running boot step worker_pool defined by app rabbit 2025-02-10 02:05:22.000 [info] <0.248.0> Will use 4 processes for default worker pool 2025-02-10 02:05:22.001 [info] <0.248.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 02:05:22.001 [info] <0.247.0> Running boot step database defined by app rabbit 2025-02-10 02:05:22.002 [info] <0.247.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-02-10 02:05:22.002 [info] <0.247.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-02-10 02:05:22.002 [info] <0.247.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 02:05:22.002 [info] <0.247.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-02-10 02:05:22.002 [info] <0.247.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-02-10 02:05:22.002 [info] <0.247.0> Will wait for 27581 milliseconds before proceeding with registration... 2025-02-10 02:05:49.584 [info] <0.247.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1, contrail@cn-jenkins-deploy-platform-ansible-os-2705-2, contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 2025-02-10 02:05:49.584 [info] <0.247.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2705-1, contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 2025-02-10 02:05:49.586 [info] <0.247.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' selected for auto-clustering 2025-02-10 02:05:49.636 [info] <0.247.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 02:05:49.697 [info] <0.247.0> Successfully synced tables from a peer 2025-02-10 02:05:49.697 [info] <0.247.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 02:05:49.698 [info] <0.247.0> Successfully synced tables from a peer 2025-02-10 02:05:49.728 [info] <0.247.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 02:05:49.729 [info] <0.247.0> Successfully synced tables from a peer 2025-02-10 02:05:49.730 [info] <0.247.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 02:05:49.730 [info] <0.247.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 02:05:49.731 [info] <0.247.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step database_sync defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step feature_flags defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 02:05:49.731 [info] <0.247.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 02:05:49.732 [info] <0.247.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 02:05:49.733 [info] <0.403.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 02:05:49.733 [info] <0.247.0> Running boot step guid_generator defined by app rabbit 2025-02-10 02:05:49.736 [info] <0.247.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 02:05:49.737 [info] <0.407.0> Starting rabbit_node_monitor 2025-02-10 02:05:49.737 [info] <0.247.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 02:05:49.738 [info] <0.247.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 02:05:49.738 [info] <0.247.0> Running boot step core_initialized defined by app rabbit 2025-02-10 02:05:49.738 [info] <0.247.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 02:05:49.759 [info] <0.247.0> message_store upgrades: 1 to apply 2025-02-10 02:05:49.760 [info] <0.247.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-10 02:05:49.760 [info] <0.247.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-10 02:05:49.760 [info] <0.247.0> message_store upgrades: Removing the old message store data 2025-02-10 02:05:49.760 [info] <0.247.0> message_store upgrades: All upgrades applied successfully 2025-02-10 02:05:49.785 [info] <0.247.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 02:05:49.785 [info] <0.247.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 02:05:49.785 [info] <0.247.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 02:05:49.785 [info] <0.247.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 02:05:49.786 [info] <0.247.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 02:05:49.786 [info] <0.247.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 02:05:49.786 [info] <0.247.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 02:05:49.786 [info] <0.247.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 02:05:49.786 [info] <0.247.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 02:05:49.786 [info] <0.247.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 02:05:49.786 [warning] <0.247.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 02:05:49.786 [info] <0.247.0> Management plugin: using rates mode 'basic' 2025-02-10 02:05:49.788 [info] <0.247.0> Running boot step recovery defined by app rabbit 2025-02-10 02:05:49.789 [info] <0.444.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 02:05:49.793 [info] <0.444.0> Starting message stores for vhost '/' 2025-02-10 02:05:49.793 [info] <0.448.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 02:05:49.794 [info] <0.444.0> Started message store of type transient for vhost '/' 2025-02-10 02:05:49.794 [info] <0.451.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 02:05:49.795 [warning] <0.451.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-10 02:05:49.795 [info] <0.444.0> Started message store of type persistent for vhost '/' 2025-02-10 02:05:49.797 [info] <0.444.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.470.0> 2025-02-10 02:05:49.797 [info] <0.444.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.474.0> 2025-02-10 02:05:49.797 [info] <0.444.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.478.0> 2025-02-10 02:05:49.798 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.482.0> 2025-02-10 02:05:49.798 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.486.0> 2025-02-10 02:05:49.798 [info] <0.444.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.490.0> 2025-02-10 02:05:49.799 [info] <0.444.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.494.0> 2025-02-10 02:05:49.799 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.498.0> 2025-02-10 02:05:49.799 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.502.0> 2025-02-10 02:05:49.799 [info] <0.444.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.506.0> 2025-02-10 02:05:49.800 [info] <0.444.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.510.0> 2025-02-10 02:05:49.800 [info] <0.444.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.514.0> 2025-02-10 02:05:49.800 [info] <0.444.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.518.0> 2025-02-10 02:05:49.800 [info] <0.444.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.522.0> 2025-02-10 02:05:49.800 [info] <0.444.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.526.0> 2025-02-10 02:05:49.800 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.530.0> 2025-02-10 02:05:49.801 [info] <0.444.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.534.0> 2025-02-10 02:05:49.801 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.538.0> 2025-02-10 02:05:49.801 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.542.0> 2025-02-10 02:05:49.801 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.546.0> 2025-02-10 02:05:49.801 [info] <0.444.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.550.0> 2025-02-10 02:05:49.802 [info] <0.444.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.554.0> 2025-02-10 02:05:49.802 [info] <0.444.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.558.0> 2025-02-10 02:05:49.802 [info] <0.444.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.562.0> 2025-02-10 02:05:49.802 [info] <0.444.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.566.0> 2025-02-10 02:05:49.802 [info] <0.444.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.570.0> 2025-02-10 02:05:49.802 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.574.0> 2025-02-10 02:05:49.803 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.578.0> 2025-02-10 02:05:49.803 [info] <0.444.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.582.0> 2025-02-10 02:05:49.803 [info] <0.444.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.586.0> 2025-02-10 02:05:49.803 [info] <0.444.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.590.0> 2025-02-10 02:05:49.803 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.594.0> 2025-02-10 02:05:49.804 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.598.0> 2025-02-10 02:05:49.804 [info] <0.444.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.602.0> 2025-02-10 02:05:49.804 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.606.0> 2025-02-10 02:05:49.804 [info] <0.444.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.610.0> 2025-02-10 02:05:49.805 [info] <0.247.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 02:05:49.805 [info] <0.247.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 02:05:49.805 [info] <0.247.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 02:05:49.805 [info] <0.247.0> Importing users... 2025-02-10 02:05:49.817 [info] <0.247.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 02:05:49.846 [info] <0.247.0> Importing vhosts... 2025-02-10 02:05:49.846 [info] <0.247.0> Importing user permissions... 2025-02-10 02:05:49.846 [info] <0.247.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 02:05:49.950 [info] <0.247.0> Importing topic permissions... 2025-02-10 02:05:49.951 [info] <0.247.0> Importing parameters... 2025-02-10 02:05:49.951 [info] <0.247.0> Importing global parameters... 2025-02-10 02:05:49.951 [info] <0.247.0> Importing policies... 2025-02-10 02:05:49.970 [info] <0.247.0> Importing queues... 2025-02-10 02:05:49.970 [info] <0.247.0> Importing exchanges... 2025-02-10 02:05:49.970 [info] <0.247.0> Importing bindings... 2025-02-10 02:05:49.970 [info] <0.247.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 02:05:49.970 [info] <0.247.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 02:05:49.970 [info] <0.247.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 02:05:49.971 [info] <0.247.0> Running boot step background_gc defined by app rabbit 2025-02-10 02:05:49.971 [info] <0.247.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 02:05:49.974 [info] <0.247.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 02:05:49.976 [info] <0.247.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 02:05:49.976 [info] <0.247.0> Running boot step routing_ready defined by app rabbit 2025-02-10 02:05:49.976 [info] <0.247.0> Running boot step pre_flight defined by app rabbit 2025-02-10 02:05:49.976 [info] <0.247.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 02:05:49.977 [info] <0.247.0> Running boot step networking defined by app rabbit 2025-02-10 02:05:49.977 [info] <0.407.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 02:05:49.978 [info] <0.744.0> started TCP listener on [::]:5673 2025-02-10 02:05:49.979 [info] <0.247.0> Running boot step cluster_name defined by app rabbit 2025-02-10 02:05:49.979 [info] <0.247.0> Running boot step direct_client defined by app rabbit 2025-02-10 02:05:49.979 [info] <0.247.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 02:05:49.979 [info] <0.746.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 02:05:50.038 [info] <0.407.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 02:05:50.076 [info] <0.870.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 02:05:50.076 [info] <0.976.0> Statistics database started. 2025-02-10 02:05:50.076 [info] <0.975.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 02:05:50.076 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 02:05:50.179 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-10 02:05:57.309 [info] <0.1001.0> RabbitMQ is asked to stop... 2025-02-10 02:05:57.436 [info] <0.1001.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-10 02:05:57.436 [info] <0.1001.0> Stopping application 'rabbitmq_management' 2025-02-10 02:05:57.438 [warning] <0.752.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-10 02:05:57.440 [info] <0.1001.0> Stopping application 'amqp_client' 2025-02-10 02:05:57.439 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-10 02:05:57.441 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-10 02:05:57.441 [info] <0.1001.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-10 02:05:57.442 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-10 02:05:57.442 [info] <0.1001.0> Stopping application 'cowboy' 2025-02-10 02:05:57.444 [info] <0.1001.0> Stopping application 'cowlib' 2025-02-10 02:05:57.444 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-10 02:05:57.444 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-10 02:05:57.444 [info] <0.1001.0> Stopping application 'rabbitmq_management_agent' 2025-02-10 02:05:57.445 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-10 02:05:57.445 [info] <0.1001.0> Stopping application 'rabbit' 2025-02-10 02:05:57.445 [info] <0.247.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 02:05:57.446 [info] <0.744.0> stopped TCP listener on [::]:5673 2025-02-10 02:05:57.447 [info] <0.432.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' because the vhost is stopping 2025-02-10 02:05:57.448 [info] <0.451.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-10 02:05:57.455 [info] <0.451.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-10 02:05:57.456 [info] <0.448.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-10 02:05:57.466 [info] <0.448.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-10 02:05:57.474 [info] <0.1001.0> Stopping application 'mnesia' 2025-02-10 02:05:57.474 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-10 02:05:57.479 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 02:05:57.479 [info] <0.1001.0> Stopping application 'rabbit_common' 2025-02-10 02:05:57.479 [info] <0.1001.0> Stopping application 'sysmon_handler' 2025-02-10 02:05:57.479 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-10 02:05:57.480 [info] <0.1001.0> Stopping application 'os_mon' 2025-02-10 02:05:57.480 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-10 02:05:57.481 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-10 02:05:57.481 [info] <0.1001.0> Successfully stopped RabbitMQ and its dependencies 2025-02-10 02:05:57.482 [info] <0.1001.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 observer_cli credentials_obfuscation tools crypto jsx stdout_formatter xmerl recon inets lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-10 02:06:04.880 [info] <0.8.0> Log file opened with Lager 2025-02-10 02:06:06.271 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-10 02:06:06.271 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-10 02:06:06.352 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-10 02:06:06.392 [info] <0.298.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-10 02:06:06.393 [info] <0.298.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2 2025-02-10 02:06:06.405 [info] <0.298.0> Running boot step pre_boot defined by app rabbit 2025-02-10 02:06:06.405 [info] <0.298.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-10 02:06:06.405 [info] <0.298.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-10 02:06:06.410 [info] <0.334.0> Memory high watermark set to 12637 MiB (13251074457 bytes) of 15796 MiB (16563843072 bytes) total 2025-02-10 02:06:06.419 [info] <0.345.0> Enabling free disk space monitoring 2025-02-10 02:06:06.419 [info] <0.345.0> Disk free limit set to 50MB 2025-02-10 02:06:06.425 [info] <0.298.0> Running boot step code_server_cache defined by app rabbit 2025-02-10 02:06:06.425 [info] <0.298.0> Running boot step file_handle_cache defined by app rabbit 2025-02-10 02:06:06.426 [info] <0.377.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-10 02:06:06.426 [info] <0.378.0> FHC read buffering: OFF 2025-02-10 02:06:06.426 [info] <0.378.0> FHC write buffering: ON 2025-02-10 02:06:06.426 [info] <0.298.0> Running boot step worker_pool defined by app rabbit 2025-02-10 02:06:06.426 [info] <0.299.0> Will use 4 processes for default worker pool 2025-02-10 02:06:06.426 [info] <0.299.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-10 02:06:06.426 [info] <0.298.0> Running boot step database defined by app rabbit 2025-02-10 02:06:06.432 [info] <0.298.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 02:06:06.434 [info] <0.298.0> Successfully synced tables from a peer 2025-02-10 02:06:06.436 [info] <0.298.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 02:06:06.436 [info] <0.298.0> Successfully synced tables from a peer 2025-02-10 02:06:06.466 [info] <0.298.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-10 02:06:06.466 [info] <0.298.0> Successfully synced tables from a peer 2025-02-10 02:06:06.467 [info] <0.298.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step database_sync defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step feature_flags defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step external_infrastructure defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step rabbit_registry defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-10 02:06:06.573 [info] <0.298.0> Running boot step rabbit_event defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-10 02:06:06.574 [info] <0.298.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-10 02:06:06.574 [info] <0.298.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-10 02:06:06.575 [info] <0.298.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-10 02:06:06.575 [info] <0.298.0> Running boot step kernel_ready defined by app rabbit 2025-02-10 02:06:06.575 [info] <0.298.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-10 02:06:06.575 [info] <0.298.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-10 02:06:06.576 [info] <0.413.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-10 02:06:06.576 [info] <0.298.0> Running boot step guid_generator defined by app rabbit 2025-02-10 02:06:06.584 [info] <0.298.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-10 02:06:06.585 [info] <0.417.0> Starting rabbit_node_monitor 2025-02-10 02:06:06.585 [info] <0.298.0> Running boot step delegate_sup defined by app rabbit 2025-02-10 02:06:06.585 [info] <0.298.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-10 02:06:06.585 [info] <0.298.0> Running boot step core_initialized defined by app rabbit 2025-02-10 02:06:06.585 [info] <0.298.0> Running boot step upgrade_queues defined by app rabbit 2025-02-10 02:06:06.606 [info] <0.298.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-10 02:06:06.606 [info] <0.298.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-10 02:06:06.606 [info] <0.298.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-10 02:06:06.606 [info] <0.298.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-10 02:06:06.607 [info] <0.298.0> Running boot step rabbit_policies defined by app rabbit 2025-02-10 02:06:06.607 [info] <0.298.0> Running boot step rabbit_policy defined by app rabbit 2025-02-10 02:06:06.607 [info] <0.298.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-10 02:06:06.607 [info] <0.298.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-10 02:06:06.608 [info] <0.298.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-10 02:06:06.608 [info] <0.298.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-10 02:06:06.608 [warning] <0.298.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-10 02:06:06.608 [info] <0.298.0> Management plugin: using rates mode 'basic' 2025-02-10 02:06:06.609 [info] <0.298.0> Running boot step recovery defined by app rabbit 2025-02-10 02:06:06.610 [info] <0.454.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2705-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-10 02:06:06.614 [info] <0.454.0> Starting message stores for vhost '/' 2025-02-10 02:06:06.614 [info] <0.458.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-10 02:06:06.615 [info] <0.454.0> Started message store of type transient for vhost '/' 2025-02-10 02:06:06.615 [info] <0.461.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-10 02:06:06.616 [info] <0.454.0> Started message store of type persistent for vhost '/' 2025-02-10 02:06:06.618 [info] <0.454.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.480.0> 2025-02-10 02:06:06.618 [info] <0.454.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.484.0> 2025-02-10 02:06:06.618 [info] <0.454.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.488.0> 2025-02-10 02:06:06.618 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.492.0> 2025-02-10 02:06:06.618 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.496.0> 2025-02-10 02:06:06.619 [info] <0.454.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.500.0> 2025-02-10 02:06:06.619 [info] <0.454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.504.0> 2025-02-10 02:06:06.619 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.508.0> 2025-02-10 02:06:06.620 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.512.0> 2025-02-10 02:06:06.620 [info] <0.454.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.517.0> 2025-02-10 02:06:06.620 [info] <0.454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.524.0> 2025-02-10 02:06:06.621 [info] <0.454.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.528.0> 2025-02-10 02:06:06.621 [info] <0.454.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.532.0> 2025-02-10 02:06:06.621 [info] <0.454.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.537.0> 2025-02-10 02:06:06.622 [info] <0.454.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.541.0> 2025-02-10 02:06:06.622 [info] <0.454.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.549.0> 2025-02-10 02:06:06.623 [info] <0.454.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.554.0> 2025-02-10 02:06:06.624 [info] <0.454.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.562.0> 2025-02-10 02:06:06.624 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.566.0> 2025-02-10 02:06:06.625 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.571.0> 2025-02-10 02:06:06.626 [info] <0.454.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.576.0> 2025-02-10 02:06:06.626 [info] <0.454.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.580.0> 2025-02-10 02:06:06.626 [info] <0.454.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.585.0> 2025-02-10 02:06:06.626 [info] <0.454.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.589.0> 2025-02-10 02:06:06.627 [info] <0.454.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.593.0> 2025-02-10 02:06:06.627 [info] <0.454.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.598.0> 2025-02-10 02:06:06.627 [info] <0.454.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.602.0> 2025-02-10 02:06:06.627 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.606.0> 2025-02-10 02:06:06.628 [info] <0.454.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.610.0> 2025-02-10 02:06:06.628 [info] <0.454.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.614.0> 2025-02-10 02:06:06.628 [info] <0.454.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.618.0> 2025-02-10 02:06:06.628 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.622.0> 2025-02-10 02:06:06.629 [info] <0.454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.626.0> 2025-02-10 02:06:06.629 [info] <0.454.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.630.0> 2025-02-10 02:06:06.629 [info] <0.454.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.634.0> 2025-02-10 02:06:06.629 [info] <0.454.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-2': <0.638.0> 2025-02-10 02:06:06.630 [info] <0.298.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-10 02:06:06.630 [info] <0.298.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-10 02:06:06.630 [info] <0.298.0> Asked to import definitions. Acting user: rmq-internal 2025-02-10 02:06:06.630 [info] <0.298.0> Importing users... 2025-02-10 02:06:06.667 [info] <0.298.0> Setting user tags for user 'guest' to [administrator] 2025-02-10 02:06:06.693 [info] <0.298.0> Importing vhosts... 2025-02-10 02:06:06.694 [info] <0.298.0> Importing user permissions... 2025-02-10 02:06:06.694 [info] <0.298.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-10 02:06:06.710 [info] <0.298.0> Importing topic permissions... 2025-02-10 02:06:06.710 [info] <0.298.0> Importing parameters... 2025-02-10 02:06:06.710 [info] <0.298.0> Importing global parameters... 2025-02-10 02:06:06.710 [info] <0.298.0> Importing policies... 2025-02-10 02:06:06.715 [info] <0.298.0> Importing queues... 2025-02-10 02:06:06.715 [info] <0.298.0> Importing exchanges... 2025-02-10 02:06:06.715 [info] <0.298.0> Importing bindings... 2025-02-10 02:06:06.715 [info] <0.298.0> Running boot step empty_db_check defined by app rabbit 2025-02-10 02:06:06.715 [info] <0.298.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-10 02:06:06.716 [info] <0.298.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-10 02:06:06.716 [info] <0.298.0> Running boot step background_gc defined by app rabbit 2025-02-10 02:06:06.716 [info] <0.298.0> Running boot step connection_tracking defined by app rabbit 2025-02-10 02:06:06.732 [info] <0.298.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 02:06:06.733 [info] <0.298.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2705-2' 2025-02-10 02:06:06.733 [info] <0.298.0> Running boot step routing_ready defined by app rabbit 2025-02-10 02:06:06.733 [info] <0.298.0> Running boot step pre_flight defined by app rabbit 2025-02-10 02:06:06.733 [info] <0.298.0> Running boot step notify_cluster defined by app rabbit 2025-02-10 02:06:06.733 [info] <0.298.0> Running boot step networking defined by app rabbit 2025-02-10 02:06:06.734 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-1' up 2025-02-10 02:06:06.735 [info] <0.754.0> started TCP listener on [::]:5673 2025-02-10 02:06:06.735 [info] <0.298.0> Running boot step cluster_name defined by app rabbit 2025-02-10 02:06:06.735 [info] <0.298.0> Running boot step direct_client defined by app rabbit 2025-02-10 02:06:06.735 [info] <0.298.0> Running boot step os_signal_handler defined by app rabbit 2025-02-10 02:06:06.736 [info] <0.756.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-10 02:06:06.749 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 02:06:06.793 [info] <0.844.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-10 02:06:06.793 [info] <0.986.0> Statistics database started. 2025-02-10 02:06:06.793 [info] <0.985.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-10 02:06:06.793 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-10 02:06:06.895 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-10 02:06:16.504 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' down 2025-02-10 02:06:16.518 [info] <0.417.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 listeners: the node is already back 2025-02-10 02:06:16.550 [info] <0.417.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' down: connection_closed 2025-02-10 02:06:16.563 [info] <0.602.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..tftp_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.563 [info] <0.580.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.590 [info] <0.598.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-2.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.590 [info] <0.614.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.596 [info] <0.492.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.598 [info] <0.562.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.599 [info] <0.634.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.606 [info] <0.512.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.607 [info] <0.566.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.609 [info] <0.508.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.609 [info] <0.524.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.609 [info] <0.571.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:16.616 [info] <0.554.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:06:48.629 [info] <0.417.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 02:06:59.974 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 02:07:01.462 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' down 2025-02-10 02:07:01.472 [info] <0.417.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2705-3 listeners: the node is already back 2025-02-10 02:07:01.573 [info] <0.1110.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.574 [info] <0.508.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.575 [info] <0.480.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-1.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.575 [info] <0.484.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.575 [info] <0.638.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2705-3.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.576 [info] <0.576.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.576 [info] <0.1127.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2705-2..dummy' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.576 [info] <0.537.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.577 [info] <0.562.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-2..tftp_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.577 [info] <0.622.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.577 [info] <0.585.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2705-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.578 [info] <0.571.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2705-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2705-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.579 [info] <0.549.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2705-3..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.579 [info] <0.610.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-1' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.580 [info] <0.589.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2705-3' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:01.581 [info] <0.630.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2705-2' in vhost '/': Slave saw deaths of mirrors 2025-02-10 02:07:02.485 [info] <0.417.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' down: connection_closed 2025-02-10 02:07:08.518 [info] <0.417.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up 2025-02-10 02:07:09.816 [info] <0.417.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2705-3' up