2025-02-13 00:45:49.006 [info] <0.8.0> Log file opened with Lager 2025-02-13 00:45:52.238 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-13 00:45:52.238 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-13 00:45:52.270 [info] <0.236.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-13 00:45:52.271 [info] <0.236.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 00:45:52.284 [info] <0.236.0> Running boot step pre_boot defined by app rabbit 2025-02-13 00:45:52.285 [info] <0.236.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-13 00:45:52.285 [info] <0.236.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-13 00:45:52.290 [info] <0.242.0> Memory high watermark set to 12637 MiB (13251077734 bytes) of 15796 MiB (16563847168 bytes) total 2025-02-13 00:45:52.297 [info] <0.244.0> Enabling free disk space monitoring 2025-02-13 00:45:52.297 [info] <0.244.0> Disk free limit set to 50MB 2025-02-13 00:45:52.304 [info] <0.236.0> Running boot step code_server_cache defined by app rabbit 2025-02-13 00:45:52.305 [info] <0.236.0> Running boot step file_handle_cache defined by app rabbit 2025-02-13 00:45:52.305 [info] <0.247.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-13 00:45:52.305 [info] <0.248.0> FHC read buffering: OFF 2025-02-13 00:45:52.305 [info] <0.248.0> FHC write buffering: ON 2025-02-13 00:45:52.310 [info] <0.236.0> Running boot step worker_pool defined by app rabbit 2025-02-13 00:45:52.310 [info] <0.237.0> Will use 4 processes for default worker pool 2025-02-13 00:45:52.310 [info] <0.237.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-13 00:45:52.311 [info] <0.236.0> Running boot step database defined by app rabbit 2025-02-13 00:45:52.314 [info] <0.236.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-02-13 00:45:52.314 [info] <0.236.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-02-13 00:45:52.314 [info] <0.236.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 00:45:52.314 [info] <0.236.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-02-13 00:45:52.314 [info] <0.236.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-02-13 00:45:52.314 [info] <0.236.0> Will wait for 59852 milliseconds before proceeding with registration... 2025-02-13 00:46:40.527 [info] <0.321.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2025-02-13 00:46:52.167 [info] <0.236.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2728-1, contrail@cn-jenkins-deploy-platform-ansible-os-2728-2, contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 2025-02-13 00:46:52.168 [info] <0.236.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2728-1, contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 2025-02-13 00:46:52.171 [info] <0.236.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' selected for auto-clustering 2025-02-13 00:46:52.187 [info] <0.236.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:46:52.188 [info] <0.236.0> Successfully synced tables from a peer 2025-02-13 00:46:52.450 [info] <0.236.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:46:52.450 [info] <0.236.0> Successfully synced tables from a peer 2025-02-13 00:46:52.491 [info] <0.236.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:46:52.491 [info] <0.236.0> Successfully synced tables from a peer 2025-02-13 00:46:52.498 [info] <0.236.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:46:52.504 [info] <0.236.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:46:52.504 [info] <0.236.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 00:46:52.504 [info] <0.236.0> Running boot step database_sync defined by app rabbit 2025-02-13 00:46:52.504 [info] <0.236.0> Running boot step feature_flags defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step external_infrastructure defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_registry defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_event defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-13 00:46:52.505 [info] <0.236.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step kernel_ready defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-13 00:46:52.506 [info] <0.236.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-13 00:46:52.507 [info] <0.487.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-13 00:46:52.507 [info] <0.236.0> Running boot step guid_generator defined by app rabbit 2025-02-13 00:46:52.511 [info] <0.236.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-13 00:46:52.511 [info] <0.491.0> Starting rabbit_node_monitor 2025-02-13 00:46:52.511 [info] <0.236.0> Running boot step delegate_sup defined by app rabbit 2025-02-13 00:46:52.512 [info] <0.236.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-13 00:46:52.512 [info] <0.236.0> Running boot step core_initialized defined by app rabbit 2025-02-13 00:46:52.512 [info] <0.236.0> Running boot step upgrade_queues defined by app rabbit 2025-02-13 00:46:52.534 [info] <0.236.0> message_store upgrades: 1 to apply 2025-02-13 00:46:52.535 [info] <0.236.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-13 00:46:52.535 [info] <0.236.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-13 00:46:52.535 [info] <0.236.0> message_store upgrades: Removing the old message store data 2025-02-13 00:46:52.535 [info] <0.236.0> message_store upgrades: All upgrades applied successfully 2025-02-13 00:46:52.561 [info] <0.236.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-13 00:46:52.561 [info] <0.236.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-13 00:46:52.561 [info] <0.236.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-13 00:46:52.561 [info] <0.236.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-13 00:46:52.562 [info] <0.236.0> Running boot step rabbit_policies defined by app rabbit 2025-02-13 00:46:52.562 [info] <0.236.0> Running boot step rabbit_policy defined by app rabbit 2025-02-13 00:46:52.562 [info] <0.236.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-13 00:46:52.562 [info] <0.236.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-13 00:46:52.562 [info] <0.236.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-13 00:46:52.562 [info] <0.236.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-13 00:46:52.563 [warning] <0.236.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-13 00:46:52.563 [info] <0.236.0> Management plugin: using rates mode 'basic' 2025-02-13 00:46:52.564 [info] <0.236.0> Running boot step recovery defined by app rabbit 2025-02-13 00:46:52.565 [info] <0.528.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-13 00:46:52.571 [info] <0.528.0> Starting message stores for vhost '/' 2025-02-13 00:46:52.571 [info] <0.532.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-13 00:46:52.572 [info] <0.528.0> Started message store of type transient for vhost '/' 2025-02-13 00:46:52.572 [info] <0.535.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-13 00:46:52.573 [warning] <0.535.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-13 00:46:52.574 [info] <0.528.0> Started message store of type persistent for vhost '/' 2025-02-13 00:46:52.575 [info] <0.236.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-13 00:46:52.575 [info] <0.236.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-13 00:46:52.575 [info] <0.236.0> Asked to import definitions. Acting user: rmq-internal 2025-02-13 00:46:52.575 [info] <0.236.0> Importing users... 2025-02-13 00:46:52.580 [info] <0.236.0> Setting user tags for user 'guest' to [administrator] 2025-02-13 00:46:52.585 [info] <0.236.0> Importing vhosts... 2025-02-13 00:46:52.585 [info] <0.236.0> Importing user permissions... 2025-02-13 00:46:52.585 [info] <0.236.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-13 00:46:52.589 [info] <0.236.0> Importing topic permissions... 2025-02-13 00:46:52.589 [info] <0.236.0> Importing parameters... 2025-02-13 00:46:52.589 [info] <0.236.0> Importing global parameters... 2025-02-13 00:46:52.589 [info] <0.236.0> Importing policies... 2025-02-13 00:46:52.594 [info] <0.236.0> Importing queues... 2025-02-13 00:46:52.594 [info] <0.236.0> Importing exchanges... 2025-02-13 00:46:52.594 [info] <0.236.0> Importing bindings... 2025-02-13 00:46:52.594 [info] <0.236.0> Running boot step empty_db_check defined by app rabbit 2025-02-13 00:46:52.594 [info] <0.236.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-13 00:46:52.594 [info] <0.236.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-13 00:46:52.595 [info] <0.236.0> Running boot step background_gc defined by app rabbit 2025-02-13 00:46:52.595 [info] <0.236.0> Running boot step connection_tracking defined by app rabbit 2025-02-13 00:46:52.595 [info] <0.236.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:46:52.596 [info] <0.236.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:46:52.596 [info] <0.236.0> Running boot step routing_ready defined by app rabbit 2025-02-13 00:46:52.596 [info] <0.236.0> Running boot step pre_flight defined by app rabbit 2025-02-13 00:46:52.596 [info] <0.236.0> Running boot step notify_cluster defined by app rabbit 2025-02-13 00:46:52.596 [info] <0.236.0> Running boot step networking defined by app rabbit 2025-02-13 00:46:52.598 [info] <0.491.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 00:46:52.599 [info] <0.576.0> started TCP listener on [::]:5673 2025-02-13 00:46:52.600 [info] <0.236.0> Running boot step cluster_name defined by app rabbit 2025-02-13 00:46:52.600 [info] <0.236.0> Running boot step direct_client defined by app rabbit 2025-02-13 00:46:52.600 [info] <0.236.0> Running boot step os_signal_handler defined by app rabbit 2025-02-13 00:46:52.600 [info] <0.578.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-13 00:46:52.654 [info] <0.633.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-13 00:46:52.654 [info] <0.739.0> Statistics database started. 2025-02-13 00:46:52.654 [info] <0.738.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-13 00:46:52.654 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-13 00:46:52.787 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2025-02-13 00:46:52.853 [info] <0.321.0> RabbitMQ is asked to stop... 2025-02-13 00:46:52.930 [info] <0.321.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-13 00:46:52.930 [info] <0.321.0> Stopping application 'rabbitmq_management' 2025-02-13 00:46:52.932 [warning] <0.625.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-13 00:46:52.934 [info] <0.321.0> Stopping application 'amqp_client' 2025-02-13 00:46:52.934 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-13 00:46:52.937 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-13 00:46:52.937 [info] <0.321.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-13 00:46:52.939 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-13 00:46:52.939 [info] <0.321.0> Stopping application 'cowboy' 2025-02-13 00:46:52.941 [info] <0.321.0> Stopping application 'cowlib' 2025-02-13 00:46:52.941 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-13 00:46:52.941 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-13 00:46:52.941 [info] <0.321.0> Stopping application 'rabbitmq_management_agent' 2025-02-13 00:46:52.943 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-13 00:46:52.943 [info] <0.321.0> Stopping application 'rabbit' 2025-02-13 00:46:52.943 [info] <0.236.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 00:46:52.943 [info] <0.576.0> stopped TCP listener on [::]:5673 2025-02-13 00:46:52.944 [info] <0.516.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' because the vhost is stopping 2025-02-13 00:46:52.944 [info] <0.535.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-13 00:46:52.948 [info] <0.535.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-13 00:46:52.948 [info] <0.532.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-13 00:46:52.958 [info] <0.532.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-13 00:46:52.961 [info] <0.321.0> Stopping application 'mnesia' 2025-02-13 00:46:52.961 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-13 00:46:52.965 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 00:46:52.965 [info] <0.321.0> Stopping application 'rabbit_common' 2025-02-13 00:46:52.965 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-13 00:46:52.965 [info] <0.321.0> Stopping application 'sysmon_handler' 2025-02-13 00:46:52.970 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-13 00:46:52.970 [info] <0.321.0> Stopping application 'os_mon' 2025-02-13 00:46:52.971 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-13 00:46:52.971 [info] <0.321.0> Successfully stopped RabbitMQ and its dependencies 2025-02-13 00:47:03.722 [info] <0.765.0> Resetting Rabbit forcefully 2025-02-13 00:47:04.646 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 00:47:04.651 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 00:47:04.758 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:04.758 [info] <0.771.0> Successfully synced tables from a peer 2025-02-13 00:47:04.787 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:04.788 [info] <0.771.0> Successfully synced tables from a peer 2025-02-13 00:47:04.815 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2025-02-13 00:47:04.815 [info] <0.771.0> Successfully synced tables from a peer 2025-02-13 00:47:04.821 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 00:47:04.834 [info] <0.771.0> Clustering with ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-3','contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] as disc node 2025-02-13 00:47:04.879 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:04.879 [info] <0.771.0> Successfully synced tables from a peer 2025-02-13 00:47:05.207 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:05.207 [info] <0.771.0> Successfully synced tables from a peer 2025-02-13 00:47:05.242 [info] <0.771.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:05.242 [info] <0.771.0> Successfully synced tables from a peer 2025-02-13 00:47:05.247 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 00:47:05.247 [error] <0.771.0> Failed to create a tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': {node_not_running,'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2'} 2025-02-13 00:47:05.247 [info] <0.771.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:47:05.248 [error] <0.771.0> Failed to create a per-vhost tracked connection table for node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': {node_not_running,'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2'} 2025-02-13 00:47:05.248 [info] <0.771.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:47:06.137 [info] <0.1133.0> RabbitMQ is asked to stop... 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'rabbitmq_management' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'amqp_client' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'rabbitmq_management_agent' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'rabbit' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'mnesia' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'rabbit_common' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'sysmon_handler' 2025-02-13 00:47:06.182 [info] <0.1133.0> Stopping application 'os_mon' 2025-02-13 00:47:06.182 [info] <0.1133.0> Successfully stopped RabbitMQ and its dependencies 2025-02-13 00:47:06.182 [info] <0.1133.0> Halting Erlang VM with the following applications: ranch ssl public_key asn1 credentials_obfuscation observer_cli jsx tools xmerl crypto stdout_formatter recon inets lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-13 00:47:12.445 [info] <0.8.0> Log file opened with Lager 2025-02-13 00:47:15.961 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-13 00:47:15.961 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-13 00:47:16.045 [info] <0.8.0> upgrades: Backing up mnesia dir to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2-upgrade-backup" 2025-02-13 00:47:16.047 [info] <0.8.0> upgrades: Mnesia dir backed up to "/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2-upgrade-backup" 2025-02-13 00:47:16.089 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 00:47:16.178 [info] <0.303.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-13 00:47:16.179 [info] <0.303.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 00:47:16.194 [info] <0.303.0> Running boot step pre_boot defined by app rabbit 2025-02-13 00:47:16.194 [info] <0.303.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-13 00:47:16.194 [info] <0.303.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-13 00:47:16.207 [info] <0.313.0> Memory high watermark set to 12637 MiB (13251077734 bytes) of 15796 MiB (16563847168 bytes) total 2025-02-13 00:47:16.220 [info] <0.323.0> Enabling free disk space monitoring 2025-02-13 00:47:16.220 [info] <0.323.0> Disk free limit set to 50MB 2025-02-13 00:47:16.226 [info] <0.303.0> Running boot step code_server_cache defined by app rabbit 2025-02-13 00:47:16.226 [info] <0.303.0> Running boot step file_handle_cache defined by app rabbit 2025-02-13 00:47:16.227 [info] <0.345.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-13 00:47:16.227 [info] <0.346.0> FHC read buffering: OFF 2025-02-13 00:47:16.227 [info] <0.346.0> FHC write buffering: ON 2025-02-13 00:47:16.227 [info] <0.303.0> Running boot step worker_pool defined by app rabbit 2025-02-13 00:47:16.227 [info] <0.304.0> Will use 4 processes for default worker pool 2025-02-13 00:47:16.227 [info] <0.304.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-13 00:47:16.228 [info] <0.303.0> Running boot step database defined by app rabbit 2025-02-13 00:47:16.241 [info] <0.303.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:16.324 [info] <0.303.0> Successfully synced tables from a peer 2025-02-13 00:47:16.332 [info] <0.303.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:16.332 [info] <0.303.0> Successfully synced tables from a peer 2025-02-13 00:47:16.365 [info] <0.303.0> upgrades: Mnesia backup removed 2025-02-13 00:47:16.365 [info] <0.303.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 00:47:16.365 [info] <0.303.0> Successfully synced tables from a peer 2025-02-13 00:47:16.365 [info] <0.303.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 00:47:16.365 [info] <0.303.0> Running boot step database_sync defined by app rabbit 2025-02-13 00:47:16.365 [info] <0.303.0> Running boot step feature_flags defined by app rabbit 2025-02-13 00:47:16.365 [info] <0.303.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-13 00:47:16.365 [info] <0.303.0> Running boot step external_infrastructure defined by app rabbit 2025-02-13 00:47:16.365 [info] <0.303.0> Running boot step rabbit_registry defined by app rabbit 2025-02-13 00:47:16.365 [info] <0.303.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_event defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-13 00:47:16.366 [info] <0.303.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step kernel_ready defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-13 00:47:16.367 [info] <0.303.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-13 00:47:16.368 [info] <0.412.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-13 00:47:16.368 [info] <0.303.0> Running boot step guid_generator defined by app rabbit 2025-02-13 00:47:16.373 [info] <0.303.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-13 00:47:16.374 [info] <0.416.0> Starting rabbit_node_monitor 2025-02-13 00:47:16.374 [info] <0.303.0> Running boot step delegate_sup defined by app rabbit 2025-02-13 00:47:16.375 [info] <0.303.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-13 00:47:16.375 [info] <0.303.0> Running boot step core_initialized defined by app rabbit 2025-02-13 00:47:16.375 [info] <0.303.0> Running boot step upgrade_queues defined by app rabbit 2025-02-13 00:47:16.402 [info] <0.303.0> message_store upgrades: 1 to apply 2025-02-13 00:47:16.402 [info] <0.303.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-13 00:47:16.402 [info] <0.303.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-13 00:47:16.402 [info] <0.303.0> message_store upgrades: Removing the old message store data 2025-02-13 00:47:16.403 [info] <0.303.0> message_store upgrades: All upgrades applied successfully 2025-02-13 00:47:16.431 [info] <0.303.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-13 00:47:16.431 [info] <0.303.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-13 00:47:16.431 [info] <0.303.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-13 00:47:16.431 [info] <0.303.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-13 00:47:16.431 [info] <0.303.0> Running boot step rabbit_policies defined by app rabbit 2025-02-13 00:47:16.432 [info] <0.303.0> Running boot step rabbit_policy defined by app rabbit 2025-02-13 00:47:16.432 [info] <0.303.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-13 00:47:16.432 [info] <0.303.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-13 00:47:16.432 [info] <0.303.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-13 00:47:16.432 [info] <0.303.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-13 00:47:16.432 [warning] <0.303.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-13 00:47:16.432 [info] <0.303.0> Management plugin: using rates mode 'basic' 2025-02-13 00:47:16.434 [info] <0.303.0> Running boot step recovery defined by app rabbit 2025-02-13 00:47:16.435 [info] <0.453.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-13 00:47:16.440 [info] <0.453.0> Starting message stores for vhost '/' 2025-02-13 00:47:16.440 [info] <0.457.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-13 00:47:16.441 [info] <0.453.0> Started message store of type transient for vhost '/' 2025-02-13 00:47:16.441 [info] <0.460.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-13 00:47:16.442 [warning] <0.460.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-13 00:47:16.443 [info] <0.453.0> Started message store of type persistent for vhost '/' 2025-02-13 00:47:16.444 [info] <0.303.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-13 00:47:16.444 [info] <0.303.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-13 00:47:16.444 [info] <0.303.0> Asked to import definitions. Acting user: rmq-internal 2025-02-13 00:47:16.445 [info] <0.303.0> Importing users... 2025-02-13 00:47:16.450 [info] <0.303.0> Setting user tags for user 'guest' to [administrator] 2025-02-13 00:47:16.456 [info] <0.303.0> Importing vhosts... 2025-02-13 00:47:16.456 [info] <0.303.0> Importing user permissions... 2025-02-13 00:47:16.456 [info] <0.303.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-13 00:47:16.466 [info] <0.303.0> Importing topic permissions... 2025-02-13 00:47:16.466 [info] <0.303.0> Importing parameters... 2025-02-13 00:47:16.466 [info] <0.303.0> Importing global parameters... 2025-02-13 00:47:16.466 [info] <0.303.0> Importing policies... 2025-02-13 00:47:16.472 [info] <0.303.0> Importing queues... 2025-02-13 00:47:16.472 [info] <0.303.0> Importing exchanges... 2025-02-13 00:47:16.472 [info] <0.303.0> Importing bindings... 2025-02-13 00:47:16.472 [info] <0.303.0> Running boot step empty_db_check defined by app rabbit 2025-02-13 00:47:16.472 [info] <0.303.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-13 00:47:16.472 [info] <0.303.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-13 00:47:16.472 [info] <0.303.0> Running boot step background_gc defined by app rabbit 2025-02-13 00:47:16.473 [info] <0.303.0> Running boot step connection_tracking defined by app rabbit 2025-02-13 00:47:16.484 [info] <0.303.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:47:16.492 [info] <0.303.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 00:47:16.492 [info] <0.303.0> Running boot step routing_ready defined by app rabbit 2025-02-13 00:47:16.492 [info] <0.303.0> Running boot step pre_flight defined by app rabbit 2025-02-13 00:47:16.492 [info] <0.303.0> Running boot step notify_cluster defined by app rabbit 2025-02-13 00:47:16.492 [info] <0.303.0> Running boot step networking defined by app rabbit 2025-02-13 00:47:16.493 [info] <0.416.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 00:47:16.495 [info] <0.507.0> started TCP listener on [::]:5673 2025-02-13 00:47:16.495 [info] <0.303.0> Running boot step cluster_name defined by app rabbit 2025-02-13 00:47:16.495 [info] <0.303.0> Running boot step direct_client defined by app rabbit 2025-02-13 00:47:16.495 [info] <0.303.0> Running boot step os_signal_handler defined by app rabbit 2025-02-13 00:47:16.496 [info] <0.509.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-13 00:47:16.503 [info] <0.416.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 00:47:16.537 [info] <0.561.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-13 00:47:16.538 [info] <0.667.0> Statistics database started. 2025-02-13 00:47:16.538 [info] <0.666.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-13 00:47:16.538 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-13 00:47:16.671 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-13 02:07:42.278 [info] <0.416.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' down 2025-02-13 02:07:42.288 [info] <0.416.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 listeners: the node is already back 2025-02-13 02:07:42.316 [info] <0.416.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' down: connection_closed 2025-02-13 02:07:42.335 [info] <0.1372.0> RabbitMQ is asked to stop... 2025-02-13 02:07:42.392 [info] <0.1249.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.403 [info] <0.1070.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.405 [info] <0.1216.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.411 [info] <0.1105.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.415 [info] <0.1172.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.418 [info] <0.1043.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.420 [info] <0.970.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-1.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.420 [info] <0.1227.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.422 [info] <0.1005.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.423 [info] <0.1178.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.424 [info] <0.1238.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.424 [info] <0.838.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..tftp_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.434 [info] <0.792.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.435 [info] <0.827.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:07:42.555 [info] <0.1372.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-13 02:07:42.555 [info] <0.1372.0> Stopping application 'rabbitmq_management' 2025-02-13 02:07:42.557 [warning] <0.515.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-13 02:07:42.559 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-13 02:07:42.559 [info] <0.1372.0> Stopping application 'amqp_client' 2025-02-13 02:07:42.561 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-13 02:07:42.561 [info] <0.1372.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-13 02:07:42.563 [info] <0.1372.0> Stopping application 'cowboy' 2025-02-13 02:07:42.563 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-13 02:07:42.565 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-13 02:07:42.565 [info] <0.1372.0> Stopping application 'cowlib' 2025-02-13 02:07:42.565 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-13 02:07:42.565 [info] <0.1372.0> Stopping application 'rabbitmq_management_agent' 2025-02-13 02:07:42.567 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-13 02:07:42.567 [info] <0.1372.0> Stopping application 'rabbit' 2025-02-13 02:07:42.567 [info] <0.303.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:07:42.567 [info] <0.507.0> stopped TCP listener on [::]:5673 2025-02-13 02:07:42.568 [info] <0.441.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' because the vhost is stopping 2025-02-13 02:07:42.569 [info] <0.460.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-13 02:07:42.575 [info] <0.460.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-13 02:07:42.575 [info] <0.457.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-13 02:07:42.579 [info] <0.457.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-13 02:07:42.586 [info] <0.1372.0> Stopping application 'mnesia' 2025-02-13 02:07:42.586 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-13 02:07:42.589 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 02:07:42.589 [info] <0.1372.0> Stopping application 'rabbit_common' 2025-02-13 02:07:42.589 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-13 02:07:42.589 [info] <0.1372.0> Stopping application 'sysmon_handler' 2025-02-13 02:07:42.591 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-13 02:07:42.591 [info] <0.1372.0> Stopping application 'os_mon' 2025-02-13 02:07:42.593 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-13 02:07:42.593 [info] <0.1372.0> Successfully stopped RabbitMQ and its dependencies 2025-02-13 02:08:14.443 [info] <0.8.0> Log file opened with Lager 2025-02-13 02:08:25.239 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-13 02:08:25.240 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-13 02:08:25.397 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 02:08:25.524 [info] <0.315.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-13 02:08:25.524 [info] <0.315.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 02:08:25.547 [info] <0.315.0> Running boot step pre_boot defined by app rabbit 2025-02-13 02:08:25.547 [info] <0.315.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-13 02:08:25.547 [info] <0.315.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-13 02:08:25.568 [info] <0.321.0> Memory high watermark set to 12637 MiB (13251077734 bytes) of 15796 MiB (16563847168 bytes) total 2025-02-13 02:08:25.596 [info] <0.324.0> Enabling free disk space monitoring 2025-02-13 02:08:25.596 [info] <0.324.0> Disk free limit set to 50MB 2025-02-13 02:08:25.619 [info] <0.315.0> Running boot step code_server_cache defined by app rabbit 2025-02-13 02:08:25.620 [info] <0.315.0> Running boot step file_handle_cache defined by app rabbit 2025-02-13 02:08:25.620 [info] <0.350.0> FHC read buffering: OFF 2025-02-13 02:08:25.621 [info] <0.350.0> FHC write buffering: ON 2025-02-13 02:08:25.620 [info] <0.349.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-13 02:08:25.642 [info] <0.315.0> Running boot step worker_pool defined by app rabbit 2025-02-13 02:08:25.642 [info] <0.316.0> Will use 4 processes for default worker pool 2025-02-13 02:08:25.642 [info] <0.316.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-13 02:08:25.642 [info] <0.315.0> Running boot step database defined by app rabbit 2025-02-13 02:08:25.723 [info] <0.315.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:08:25.744 [info] <0.315.0> Successfully synced tables from a peer 2025-02-13 02:08:25.752 [info] <0.315.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:08:25.752 [info] <0.315.0> Successfully synced tables from a peer 2025-02-13 02:08:25.840 [info] <0.315.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:08:25.844 [info] <0.315.0> Successfully synced tables from a peer 2025-02-13 02:08:25.844 [info] <0.315.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:08:25.845 [info] <0.315.0> Running boot step database_sync defined by app rabbit 2025-02-13 02:08:25.845 [info] <0.315.0> Running boot step feature_flags defined by app rabbit 2025-02-13 02:08:25.857 [info] <0.315.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-13 02:08:25.858 [info] <0.315.0> Running boot step external_infrastructure defined by app rabbit 2025-02-13 02:08:25.858 [info] <0.315.0> Running boot step rabbit_registry defined by app rabbit 2025-02-13 02:08:25.858 [info] <0.315.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-13 02:08:25.859 [info] <0.315.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_event defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-13 02:08:25.860 [info] <0.315.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-13 02:08:25.861 [info] <0.315.0> Running boot step kernel_ready defined by app rabbit 2025-02-13 02:08:25.861 [info] <0.315.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-13 02:08:25.861 [info] <0.315.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-13 02:08:25.866 [info] <0.418.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-13 02:08:25.866 [info] <0.315.0> Running boot step guid_generator defined by app rabbit 2025-02-13 02:08:25.879 [info] <0.315.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-13 02:08:25.880 [info] <0.422.0> Starting rabbit_node_monitor 2025-02-13 02:08:25.880 [info] <0.315.0> Running boot step delegate_sup defined by app rabbit 2025-02-13 02:08:25.881 [info] <0.315.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-13 02:08:25.883 [info] <0.315.0> Running boot step core_initialized defined by app rabbit 2025-02-13 02:08:25.884 [info] <0.315.0> Running boot step upgrade_queues defined by app rabbit 2025-02-13 02:08:25.957 [info] <0.315.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-13 02:08:25.958 [info] <0.315.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-13 02:08:25.958 [info] <0.315.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-13 02:08:25.958 [info] <0.315.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-13 02:08:25.959 [info] <0.315.0> Running boot step rabbit_policies defined by app rabbit 2025-02-13 02:08:25.959 [info] <0.315.0> Running boot step rabbit_policy defined by app rabbit 2025-02-13 02:08:25.959 [info] <0.315.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-13 02:08:25.959 [info] <0.315.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-13 02:08:25.959 [info] <0.315.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-13 02:08:25.959 [info] <0.315.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-13 02:08:25.959 [warning] <0.315.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-13 02:08:25.959 [info] <0.315.0> Management plugin: using rates mode 'basic' 2025-02-13 02:08:25.966 [info] <0.315.0> Running boot step recovery defined by app rabbit 2025-02-13 02:08:25.977 [info] <0.459.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-13 02:08:25.992 [info] <0.459.0> Starting message stores for vhost '/' 2025-02-13 02:08:25.992 [info] <0.463.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:08:25.996 [info] <0.459.0> Started message store of type transient for vhost '/' 2025-02-13 02:08:25.996 [info] <0.466.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:08:26.035 [info] <0.459.0> Started message store of type persistent for vhost '/' 2025-02-13 02:08:26.037 [info] <0.459.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.485.0> 2025-02-13 02:08:26.037 [info] <0.459.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.489.0> 2025-02-13 02:08:26.038 [info] <0.459.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.493.0> 2025-02-13 02:08:26.038 [info] <0.459.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.497.0> 2025-02-13 02:08:26.038 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.501.0> 2025-02-13 02:08:26.039 [info] <0.459.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.505.0> 2025-02-13 02:08:26.039 [info] <0.459.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.509.0> 2025-02-13 02:08:26.039 [info] <0.459.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.513.0> 2025-02-13 02:08:26.040 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.517.0> 2025-02-13 02:08:26.040 [info] <0.459.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.521.0> 2025-02-13 02:08:26.041 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.525.0> 2025-02-13 02:08:26.041 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.529.0> 2025-02-13 02:08:26.041 [info] <0.459.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.533.0> 2025-02-13 02:08:26.042 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.537.0> 2025-02-13 02:08:26.042 [info] <0.459.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.541.0> 2025-02-13 02:08:26.043 [info] <0.459.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.545.0> 2025-02-13 02:08:26.043 [info] <0.459.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.549.0> 2025-02-13 02:08:26.043 [info] <0.459.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.553.0> 2025-02-13 02:08:26.044 [info] <0.459.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.557.0> 2025-02-13 02:08:26.044 [info] <0.459.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.561.0> 2025-02-13 02:08:26.045 [info] <0.459.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.565.0> 2025-02-13 02:08:26.046 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.571.0> 2025-02-13 02:08:26.046 [info] <0.459.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.577.0> 2025-02-13 02:08:26.046 [info] <0.459.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.581.0> 2025-02-13 02:08:26.047 [info] <0.459.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.585.0> 2025-02-13 02:08:26.047 [info] <0.459.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.589.0> 2025-02-13 02:08:26.057 [info] <0.315.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-13 02:08:26.058 [info] <0.315.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-13 02:08:26.058 [info] <0.315.0> Asked to import definitions. Acting user: rmq-internal 2025-02-13 02:08:26.058 [info] <0.315.0> Importing users... 2025-02-13 02:08:26.104 [info] <0.315.0> Setting user tags for user 'guest' to [administrator] 2025-02-13 02:08:26.186 [info] <0.315.0> Importing vhosts... 2025-02-13 02:08:26.186 [info] <0.315.0> Importing user permissions... 2025-02-13 02:08:26.186 [info] <0.315.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-13 02:08:26.241 [info] <0.315.0> Importing topic permissions... 2025-02-13 02:08:26.241 [info] <0.315.0> Importing parameters... 2025-02-13 02:08:26.241 [info] <0.315.0> Importing global parameters... 2025-02-13 02:08:26.241 [info] <0.315.0> Importing policies... 2025-02-13 02:08:26.260 [info] <0.315.0> Importing queues... 2025-02-13 02:08:26.260 [info] <0.315.0> Importing exchanges... 2025-02-13 02:08:26.261 [info] <0.315.0> Importing bindings... 2025-02-13 02:08:26.261 [info] <0.315.0> Running boot step empty_db_check defined by app rabbit 2025-02-13 02:08:26.261 [info] <0.315.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-13 02:08:26.261 [info] <0.315.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-13 02:08:26.262 [info] <0.315.0> Running boot step background_gc defined by app rabbit 2025-02-13 02:08:26.262 [info] <0.315.0> Running boot step connection_tracking defined by app rabbit 2025-02-13 02:08:26.282 [info] <0.315.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:08:26.287 [info] <0.315.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:08:26.287 [info] <0.315.0> Running boot step routing_ready defined by app rabbit 2025-02-13 02:08:26.287 [info] <0.315.0> Running boot step pre_flight defined by app rabbit 2025-02-13 02:08:26.287 [info] <0.315.0> Running boot step notify_cluster defined by app rabbit 2025-02-13 02:08:26.287 [info] <0.315.0> Running boot step networking defined by app rabbit 2025-02-13 02:08:26.288 [info] <0.422.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 02:08:26.300 [info] <0.689.0> started TCP listener on [::]:5673 2025-02-13 02:08:26.300 [info] <0.315.0> Running boot step cluster_name defined by app rabbit 2025-02-13 02:08:26.300 [info] <0.315.0> Running boot step direct_client defined by app rabbit 2025-02-13 02:08:26.300 [info] <0.315.0> Running boot step os_signal_handler defined by app rabbit 2025-02-13 02:08:26.301 [info] <0.692.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-13 02:08:26.582 [info] <0.768.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-13 02:08:26.583 [info] <0.874.0> Statistics database started. 2025-02-13 02:08:26.583 [info] <0.873.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-13 02:08:26.584 [notice] <0.116.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-13 02:08:28.434 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2025-02-13 02:08:32.505 [info] <0.1050.0> RabbitMQ is asked to stop... 2025-02-13 02:08:32.755 [info] <0.1050.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-13 02:08:32.756 [info] <0.1050.0> Stopping application 'rabbitmq_management' 2025-02-13 02:08:32.758 [warning] <0.764.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-13 02:08:32.761 [info] <0.1050.0> Stopping application 'amqp_client' 2025-02-13 02:08:32.761 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-13 02:08:32.766 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-13 02:08:32.766 [info] <0.1050.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-13 02:08:32.768 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-13 02:08:32.768 [info] <0.1050.0> Stopping application 'cowboy' 2025-02-13 02:08:32.779 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-13 02:08:32.779 [info] <0.1050.0> Stopping application 'cowlib' 2025-02-13 02:08:32.779 [info] <0.1050.0> Stopping application 'rabbitmq_management_agent' 2025-02-13 02:08:32.779 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-13 02:08:32.781 [info] <0.1050.0> Stopping application 'rabbit' 2025-02-13 02:08:32.781 [info] <0.315.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:08:32.781 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-13 02:08:32.782 [info] <0.689.0> stopped TCP listener on [::]:5673 2025-02-13 02:08:32.785 [info] <0.447.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' because the vhost is stopping 2025-02-13 02:08:40.333 [info] <0.422.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:08:40.842 [info] <0.422.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:09:02.787 [error] <0.1069.0> Supervisor {<0.1069.0>,rabbit_amqqueue_sup} had child rabbit_amqqueue started with rabbit_prequeue:start_link({amqqueue,{resource,<<"/">>,queue,<<"job_status_consumer.dummy">>},false,true,none,[],<5874.5430.0>,...}, slave, <0.1068.0>) at <0.1070.0> exit with reason killed in context shutdown_error 2025-02-13 02:09:02.787 [info] <0.466.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-13 02:09:02.797 [info] <0.466.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-13 02:09:02.797 [info] <0.463.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-13 02:09:02.814 [info] <0.463.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-13 02:09:02.822 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-13 02:09:02.822 [info] <0.1050.0> Stopping application 'mnesia' 2025-02-13 02:09:02.826 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 02:09:02.826 [info] <0.1050.0> Stopping application 'rabbit_common' 2025-02-13 02:09:02.826 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-13 02:09:02.826 [info] <0.1050.0> Stopping application 'sysmon_handler' 2025-02-13 02:09:02.831 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-13 02:09:02.831 [info] <0.1050.0> Stopping application 'os_mon' 2025-02-13 02:09:02.833 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-13 02:09:02.833 [info] <0.1050.0> Successfully stopped RabbitMQ and its dependencies 2025-02-13 02:09:02.833 [info] <0.1050.0> Halting Erlang VM with the following applications: jsx ranch ssl public_key asn1 stdout_formatter xmerl inets observer_cli recon tools credentials_obfuscation crypto lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-13 02:09:16.970 [info] <0.8.0> Log file opened with Lager 2025-02-13 02:09:21.787 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-13 02:09:21.787 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-13 02:09:21.889 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 02:09:21.999 [info] <0.305.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-13 02:09:22.000 [info] <0.305.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 02:09:22.018 [info] <0.305.0> Running boot step pre_boot defined by app rabbit 2025-02-13 02:09:22.018 [info] <0.305.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-13 02:09:22.020 [info] <0.305.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-13 02:09:22.033 [info] <0.315.0> Memory high watermark set to 12637 MiB (13251077734 bytes) of 15796 MiB (16563847168 bytes) total 2025-02-13 02:09:22.049 [info] <0.329.0> Enabling free disk space monitoring 2025-02-13 02:09:22.049 [info] <0.329.0> Disk free limit set to 50MB 2025-02-13 02:09:22.060 [info] <0.305.0> Running boot step code_server_cache defined by app rabbit 2025-02-13 02:09:22.060 [info] <0.305.0> Running boot step file_handle_cache defined by app rabbit 2025-02-13 02:09:22.060 [info] <0.352.0> FHC read buffering: OFF 2025-02-13 02:09:22.060 [info] <0.352.0> FHC write buffering: ON 2025-02-13 02:09:22.060 [info] <0.351.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-13 02:09:22.060 [info] <0.305.0> Running boot step worker_pool defined by app rabbit 2025-02-13 02:09:22.061 [info] <0.306.0> Will use 4 processes for default worker pool 2025-02-13 02:09:22.061 [info] <0.306.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-13 02:09:22.061 [info] <0.305.0> Running boot step database defined by app rabbit 2025-02-13 02:09:22.082 [info] <0.305.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:09:22.139 [info] <0.305.0> Successfully synced tables from a peer 2025-02-13 02:09:22.141 [info] <0.305.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:09:22.141 [info] <0.305.0> Successfully synced tables from a peer 2025-02-13 02:09:22.179 [info] <0.305.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:09:22.179 [info] <0.305.0> Successfully synced tables from a peer 2025-02-13 02:09:22.179 [info] <0.305.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:09:22.179 [info] <0.305.0> Running boot step database_sync defined by app rabbit 2025-02-13 02:09:22.179 [info] <0.305.0> Running boot step feature_flags defined by app rabbit 2025-02-13 02:09:22.179 [info] <0.305.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step external_infrastructure defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_registry defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_event defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-13 02:09:22.180 [info] <0.305.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step kernel_ready defined by app rabbit 2025-02-13 02:09:22.181 [info] <0.305.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-13 02:09:22.182 [info] <0.305.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-13 02:09:22.183 [info] <0.416.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-13 02:09:22.183 [info] <0.305.0> Running boot step guid_generator defined by app rabbit 2025-02-13 02:09:22.187 [info] <0.305.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-13 02:09:22.190 [info] <0.420.0> Starting rabbit_node_monitor 2025-02-13 02:09:22.190 [info] <0.305.0> Running boot step delegate_sup defined by app rabbit 2025-02-13 02:09:22.190 [info] <0.305.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-13 02:09:22.191 [info] <0.305.0> Running boot step core_initialized defined by app rabbit 2025-02-13 02:09:22.191 [info] <0.305.0> Running boot step upgrade_queues defined by app rabbit 2025-02-13 02:09:22.218 [info] <0.305.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-13 02:09:22.218 [info] <0.305.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-13 02:09:22.218 [info] <0.305.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-13 02:09:22.218 [info] <0.305.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-13 02:09:22.219 [info] <0.305.0> Running boot step rabbit_policies defined by app rabbit 2025-02-13 02:09:22.219 [info] <0.305.0> Running boot step rabbit_policy defined by app rabbit 2025-02-13 02:09:22.219 [info] <0.305.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-13 02:09:22.219 [info] <0.305.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-13 02:09:22.220 [info] <0.305.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-13 02:09:22.220 [info] <0.305.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-13 02:09:22.220 [warning] <0.305.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-13 02:09:22.220 [info] <0.305.0> Management plugin: using rates mode 'basic' 2025-02-13 02:09:22.224 [info] <0.305.0> Running boot step recovery defined by app rabbit 2025-02-13 02:09:22.225 [info] <0.457.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-13 02:09:22.230 [info] <0.457.0> Starting message stores for vhost '/' 2025-02-13 02:09:22.231 [info] <0.461.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:09:22.237 [info] <0.457.0> Started message store of type transient for vhost '/' 2025-02-13 02:09:22.238 [info] <0.464.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:09:22.243 [info] <0.457.0> Started message store of type persistent for vhost '/' 2025-02-13 02:09:22.245 [info] <0.457.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.483.0> 2025-02-13 02:09:22.245 [info] <0.457.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.487.0> 2025-02-13 02:09:22.246 [info] <0.457.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.491.0> 2025-02-13 02:09:22.246 [info] <0.457.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.495.0> 2025-02-13 02:09:22.246 [info] <0.457.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.498.0> 2025-02-13 02:09:22.246 [info] <0.457.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.503.0> 2025-02-13 02:09:22.247 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.507.0> 2025-02-13 02:09:22.247 [info] <0.457.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.511.0> 2025-02-13 02:09:22.248 [info] <0.457.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.515.0> 2025-02-13 02:09:22.248 [info] <0.457.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.519.0> 2025-02-13 02:09:22.248 [info] <0.457.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.523.0> 2025-02-13 02:09:22.249 [info] <0.457.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.527.0> 2025-02-13 02:09:22.249 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.531.0> 2025-02-13 02:09:22.250 [info] <0.457.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.539.0> 2025-02-13 02:09:22.250 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.543.0> 2025-02-13 02:09:22.251 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.547.0> 2025-02-13 02:09:22.251 [info] <0.457.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.551.0> 2025-02-13 02:09:22.251 [info] <0.457.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.555.0> 2025-02-13 02:09:22.251 [info] <0.457.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.559.0> 2025-02-13 02:09:22.251 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.563.0> 2025-02-13 02:09:22.252 [info] <0.457.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.567.0> 2025-02-13 02:09:22.252 [info] <0.457.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.571.0> 2025-02-13 02:09:22.252 [info] <0.457.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.575.0> 2025-02-13 02:09:22.253 [info] <0.457.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.579.0> 2025-02-13 02:09:22.253 [info] <0.457.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.584.0> 2025-02-13 02:09:22.254 [info] <0.457.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.590.0> 2025-02-13 02:09:22.254 [info] <0.457.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.598.0> 2025-02-13 02:09:22.255 [info] <0.457.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.603.0> 2025-02-13 02:09:22.255 [info] <0.457.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.607.0> 2025-02-13 02:09:22.256 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.611.0> 2025-02-13 02:09:22.256 [info] <0.457.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.615.0> 2025-02-13 02:09:22.258 [info] <0.457.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.620.0> 2025-02-13 02:09:22.259 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.629.0> 2025-02-13 02:09:22.260 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.635.0> 2025-02-13 02:09:22.260 [info] <0.457.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.639.0> 2025-02-13 02:09:22.260 [info] <0.457.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.643.0> 2025-02-13 02:09:22.260 [info] <0.305.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-13 02:09:22.261 [info] <0.305.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-13 02:09:22.261 [info] <0.305.0> Asked to import definitions. Acting user: rmq-internal 2025-02-13 02:09:22.261 [info] <0.305.0> Importing users... 2025-02-13 02:09:22.331 [info] <0.305.0> Setting user tags for user 'guest' to [administrator] 2025-02-13 02:09:22.402 [info] <0.305.0> Importing vhosts... 2025-02-13 02:09:22.402 [info] <0.305.0> Importing user permissions... 2025-02-13 02:09:22.402 [info] <0.305.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-13 02:09:22.429 [info] <0.305.0> Importing topic permissions... 2025-02-13 02:09:22.429 [info] <0.305.0> Importing parameters... 2025-02-13 02:09:22.429 [info] <0.305.0> Importing global parameters... 2025-02-13 02:09:22.429 [info] <0.305.0> Importing policies... 2025-02-13 02:09:22.446 [info] <0.305.0> Importing queues... 2025-02-13 02:09:22.446 [info] <0.305.0> Importing exchanges... 2025-02-13 02:09:22.446 [info] <0.305.0> Importing bindings... 2025-02-13 02:09:22.446 [info] <0.305.0> Running boot step empty_db_check defined by app rabbit 2025-02-13 02:09:22.447 [info] <0.305.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-13 02:09:22.447 [info] <0.305.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-13 02:09:22.447 [info] <0.305.0> Running boot step background_gc defined by app rabbit 2025-02-13 02:09:22.447 [info] <0.305.0> Running boot step connection_tracking defined by app rabbit 2025-02-13 02:09:22.450 [info] <0.305.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:09:22.453 [info] <0.305.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:09:22.454 [info] <0.305.0> Running boot step routing_ready defined by app rabbit 2025-02-13 02:09:22.454 [info] <0.305.0> Running boot step pre_flight defined by app rabbit 2025-02-13 02:09:22.454 [info] <0.305.0> Running boot step notify_cluster defined by app rabbit 2025-02-13 02:09:22.454 [info] <0.305.0> Running boot step networking defined by app rabbit 2025-02-13 02:09:22.454 [info] <0.420.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 02:09:22.456 [info] <0.757.0> started TCP listener on [::]:5673 2025-02-13 02:09:22.457 [info] <0.305.0> Running boot step cluster_name defined by app rabbit 2025-02-13 02:09:22.457 [info] <0.305.0> Running boot step direct_client defined by app rabbit 2025-02-13 02:09:22.457 [info] <0.305.0> Running boot step os_signal_handler defined by app rabbit 2025-02-13 02:09:22.458 [info] <0.759.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-13 02:09:22.512 [info] <0.420.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:09:22.612 [info] <0.883.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-13 02:09:22.612 [info] <0.989.0> Statistics database started. 2025-02-13 02:09:22.612 [info] <0.988.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-13 02:09:22.613 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-13 02:09:22.803 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-13 02:16:03.917 [info] <0.1650.0> accepting AMQP connection <0.1650.0> (10.0.0.12:48230 -> 10.0.0.35:5673) 2025-02-13 02:16:03.918 [info] <0.1647.0> accepting AMQP connection <0.1647.0> (10.0.0.46:50612 -> 10.0.0.35:5673) 2025-02-13 02:16:03.919 [info] <0.1653.0> accepting AMQP connection <0.1653.0> (10.0.0.12:48246 -> 10.0.0.35:5673) 2025-02-13 02:16:03.919 [info] <0.1656.0> accepting AMQP connection <0.1656.0> (10.0.0.46:50626 -> 10.0.0.35:5673) 2025-02-13 02:16:03.938 [info] <0.1661.0> accepting AMQP connection <0.1661.0> (10.0.0.12:48260 -> 10.0.0.35:5673) 2025-02-13 02:16:03.939 [info] <0.1666.0> accepting AMQP connection <0.1666.0> (10.0.0.12:48262 -> 10.0.0.35:5673) 2025-02-13 02:16:03.939 [info] <0.1653.0> connection <0.1653.0> (10.0.0.12:48246 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.939 [info] <0.1671.0> accepting AMQP connection <0.1671.0> (10.0.0.46:50656 -> 10.0.0.35:5673) 2025-02-13 02:16:03.939 [info] <0.1650.0> connection <0.1650.0> (10.0.0.12:48230 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.939 [info] <0.1647.0> connection <0.1647.0> (10.0.0.46:50612 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.943 [info] <0.1680.0> accepting AMQP connection <0.1680.0> (10.0.0.35:36382 -> 10.0.0.35:5673) 2025-02-13 02:16:03.943 [info] <0.1683.0> accepting AMQP connection <0.1683.0> (10.0.0.35:36378 -> 10.0.0.35:5673) 2025-02-13 02:16:03.943 [info] <0.1686.0> accepting AMQP connection <0.1686.0> (10.0.0.46:50638 -> 10.0.0.35:5673) 2025-02-13 02:16:03.943 [info] <0.1689.0> accepting AMQP connection <0.1689.0> (10.0.0.12:48264 -> 10.0.0.35:5673) 2025-02-13 02:16:03.944 [info] <0.1692.0> accepting AMQP connection <0.1692.0> (10.0.0.46:50642 -> 10.0.0.35:5673) 2025-02-13 02:16:03.944 [info] <0.1695.0> accepting AMQP connection <0.1695.0> (10.0.0.12:48248 -> 10.0.0.35:5673) 2025-02-13 02:16:03.944 [info] <0.1698.0> accepting AMQP connection <0.1698.0> (10.0.0.35:36396 -> 10.0.0.35:5673) 2025-02-13 02:16:03.946 [info] <0.1710.0> accepting AMQP connection <0.1710.0> (10.0.0.12:48270 -> 10.0.0.35:5673) 2025-02-13 02:16:03.946 [info] <0.1705.0> accepting AMQP connection <0.1705.0> (10.0.0.46:50662 -> 10.0.0.35:5673) 2025-02-13 02:16:03.946 [info] <0.1713.0> accepting AMQP connection <0.1713.0> (10.0.0.12:48278 -> 10.0.0.35:5673) 2025-02-13 02:16:03.946 [info] <0.1717.0> accepting AMQP connection <0.1717.0> (10.0.0.46:50676 -> 10.0.0.35:5673) 2025-02-13 02:16:03.955 [info] <0.1721.0> accepting AMQP connection <0.1721.0> (10.0.0.12:48290 -> 10.0.0.35:5673) 2025-02-13 02:16:03.955 [info] <0.1724.0> accepting AMQP connection <0.1724.0> (10.0.0.35:36406 -> 10.0.0.35:5673) 2025-02-13 02:16:03.955 [info] <0.1727.0> accepting AMQP connection <0.1727.0> (10.0.0.35:36412 -> 10.0.0.35:5673) 2025-02-13 02:16:03.958 [info] <0.1734.0> accepting AMQP connection <0.1734.0> (10.0.0.35:36432 -> 10.0.0.35:5673) 2025-02-13 02:16:03.959 [info] <0.1737.0> accepting AMQP connection <0.1737.0> (10.0.0.35:36442 -> 10.0.0.35:5673) 2025-02-13 02:16:03.959 [info] <0.1731.0> accepting AMQP connection <0.1731.0> (10.0.0.35:36426 -> 10.0.0.35:5673) 2025-02-13 02:16:03.960 [info] <0.1656.0> connection <0.1656.0> (10.0.0.46:50626 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.972 [info] <0.1692.0> connection <0.1692.0> (10.0.0.46:50642 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.986 [info] <0.1695.0> connection <0.1695.0> (10.0.0.12:48248 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.987 [info] <0.1698.0> connection <0.1698.0> (10.0.0.35:36396 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.988 [info] <0.1686.0> connection <0.1686.0> (10.0.0.46:50638 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.988 [info] <0.1671.0> connection <0.1671.0> (10.0.0.46:50656 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.988 [info] <0.1666.0> connection <0.1666.0> (10.0.0.12:48262 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.988 [info] <0.1683.0> connection <0.1683.0> (10.0.0.35:36378 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.988 [info] <0.1689.0> connection <0.1689.0> (10.0.0.12:48264 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.990 [info] <0.1680.0> connection <0.1680.0> (10.0.0.35:36382 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.991 [info] <0.1717.0> connection <0.1717.0> (10.0.0.46:50676 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.991 [info] <0.1661.0> connection <0.1661.0> (10.0.0.12:48260 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.991 [info] <0.1724.0> connection <0.1724.0> (10.0.0.35:36406 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:03.992 [info] <0.1710.0> connection <0.1710.0> (10.0.0.12:48270 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.005 [info] <0.1713.0> connection <0.1713.0> (10.0.0.12:48278 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.005 [info] <0.1705.0> connection <0.1705.0> (10.0.0.46:50662 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.005 [info] <0.1721.0> connection <0.1721.0> (10.0.0.12:48290 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.022 [info] <0.1727.0> connection <0.1727.0> (10.0.0.35:36412 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.023 [info] <0.1734.0> connection <0.1734.0> (10.0.0.35:36432 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.023 [info] <0.1731.0> connection <0.1731.0> (10.0.0.35:36426 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.030 [info] <0.1737.0> connection <0.1737.0> (10.0.0.35:36442 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.127 [info] <0.1885.0> accepting AMQP connection <0.1885.0> (10.0.0.12:48302 -> 10.0.0.35:5673) 2025-02-13 02:16:04.129 [info] <0.420.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' down 2025-02-13 02:16:04.131 [info] <0.1885.0> connection <0.1885.0> (10.0.0.12:48302 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.132 [info] <0.1892.0> accepting AMQP connection <0.1892.0> (10.0.0.12:48312 -> 10.0.0.35:5673) 2025-02-13 02:16:04.133 [info] <0.1899.0> accepting AMQP connection <0.1899.0> (10.0.0.46:50680 -> 10.0.0.35:5673) 2025-02-13 02:16:04.139 [info] <0.1892.0> connection <0.1892.0> (10.0.0.12:48312 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.143 [info] <0.1909.0> accepting AMQP connection <0.1909.0> (10.0.0.35:36448 -> 10.0.0.35:5673) 2025-02-13 02:16:04.144 [info] <0.420.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2728-1 listeners: the node is already back 2025-02-13 02:16:04.160 [info] <0.420.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' down: connection_closed 2025-02-13 02:16:04.163 [info] <0.1899.0> connection <0.1899.0> (10.0.0.46:50680 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.172 [info] <0.1909.0> connection <0.1909.0> (10.0.0.35:36448 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:16:04.225 [info] <0.1429.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:16:04.226 [info] <0.1429.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Promoting slave to master 2025-02-13 02:16:04.227 [info] <0.1429.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:16:04.227 [info] <0.1429.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:16:04.229 [info] <0.1308.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:16:04.231 [info] <0.1640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Promoting slave to master 2025-02-13 02:16:04.231 [info] <0.503.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:16:04.232 [info] <0.1640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:16:04.232 [info] <0.1640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:16:04.241 [info] <0.1308.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Promoting slave to master 2025-02-13 02:16:04.243 [info] <0.1992.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:16:04.245 [info] <0.1308.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:16:04.252 [info] <0.1308.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:16:04.274 [info] <0.1979.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:16:04.286 [info] <0.2006.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:16:04.309 [info] <0.1912.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3': <5876.1972.0> 2025-02-13 02:16:04.309 [info] <0.1922.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3': <5876.1976.0> 2025-02-13 02:16:05.307 [warning] lager_file_backend dropped 118 messages in the last second that exceeded the limit of 50 messages/sec 2025-02-13 02:16:37.310 [info] <0.420.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 02:17:11.949 [info] <0.2332.0> accepting AMQP connection <0.2332.0> (10.0.0.12:49136 -> 10.0.0.35:5673) 2025-02-13 02:17:11.951 [info] <0.2332.0> connection <0.2332.0> (10.0.0.12:49136 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:11.971 [info] <0.2341.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3': <5876.2185.0> 2025-02-13 02:17:11.976 [info] <0.2341.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:11.976 [info] <0.2341.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:11.978 [info] <0.2348.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:11.988 [info] <0.2352.0> accepting AMQP connection <0.2352.0> (10.0.0.12:49140 -> 10.0.0.35:5673) 2025-02-13 02:17:11.990 [info] <0.2352.0> connection <0.2352.0> (10.0.0.12:49140 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.005 [info] <0.2332.0> closing AMQP connection <0.2332.0> (10.0.0.12:49136 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.006 [info] <0.2352.0> closing AMQP connection <0.2352.0> (10.0.0.12:49140 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.179 [info] <0.2367.0> accepting AMQP connection <0.2367.0> (10.0.0.46:45848 -> 10.0.0.35:5673) 2025-02-13 02:17:12.183 [info] <0.2367.0> connection <0.2367.0> (10.0.0.46:45848 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.206 [info] <0.2376.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3': <5876.2197.0> 2025-02-13 02:17:12.211 [info] <0.2376.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:12.211 [info] <0.2376.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:12.212 [info] <0.2383.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:12.232 [info] <0.2387.0> accepting AMQP connection <0.2387.0> (10.0.0.46:45856 -> 10.0.0.35:5673) 2025-02-13 02:17:12.236 [info] <0.2387.0> connection <0.2387.0> (10.0.0.46:45856 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.253 [info] <0.2367.0> closing AMQP connection <0.2367.0> (10.0.0.46:45848 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.254 [info] <0.2387.0> closing AMQP connection <0.2387.0> (10.0.0.46:45856 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.482 [info] <0.2402.0> accepting AMQP connection <0.2402.0> (10.0.0.35:42538 -> 10.0.0.35:5673) 2025-02-13 02:17:12.485 [info] <0.2402.0> connection <0.2402.0> (10.0.0.35:42538 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.509 [info] <0.2411.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3': <5876.2209.0> 2025-02-13 02:17:12.514 [info] <0.2411.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:12.514 [info] <0.2411.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:12.515 [info] <0.2419.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:12.528 [info] <0.2422.0> accepting AMQP connection <0.2422.0> (10.0.0.35:42554 -> 10.0.0.35:5673) 2025-02-13 02:17:12.530 [info] <0.2422.0> connection <0.2422.0> (10.0.0.35:42554 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.543 [info] <0.2402.0> closing AMQP connection <0.2402.0> (10.0.0.35:42538 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.544 [info] <0.2422.0> closing AMQP connection <0.2422.0> (10.0.0.35:42554 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.842 [info] <0.2437.0> accepting AMQP connection <0.2437.0> (10.0.0.46:45864 -> 10.0.0.35:5673) 2025-02-13 02:17:12.845 [info] <0.2437.0> connection <0.2437.0> (10.0.0.46:45864 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.865 [info] <0.2446.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3': <5876.2221.0> 2025-02-13 02:17:12.872 [info] <0.2446.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:12.872 [info] <0.2446.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:12.874 [info] <0.2453.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:12.890 [info] <0.2457.0> accepting AMQP connection <0.2457.0> (10.0.0.46:45868 -> 10.0.0.35:5673) 2025-02-13 02:17:12.892 [info] <0.2457.0> connection <0.2457.0> (10.0.0.46:45868 -> 10.0.0.35:5673): user 'guest' authenticated and granted access to vhost '/' 2025-02-13 02:17:12.907 [info] <0.2437.0> closing AMQP connection <0.2437.0> (10.0.0.46:45864 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:12.908 [info] <0.2457.0> closing AMQP connection <0.2457.0> (10.0.0.46:45868 -> 10.0.0.35:5673, vhost: '/', user: 'guest') 2025-02-13 02:17:18.550 [info] <0.1169.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.551 [info] <0.1169.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.551 [info] <0.1949.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.551 [info] <0.1949.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.553 [info] <0.1493.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.554 [info] <0.1922.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.554 [info] <0.1922.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.554 [info] <0.1640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.554 [info] <0.1640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.554 [info] <0.1282.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.554 [info] <0.1282.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.554 [info] <0.1308.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.554 [info] <0.1308.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.555 [info] <0.1493.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.559 [info] <0.1955.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-2..dummy' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.559 [info] <0.1955.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-2..dummy' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.559 [info] <0.1454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.559 [info] <0.1454.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.562 [info] <0.2522.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:18.562 [info] <0.2520.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:18.564 [info] <0.1467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.564 [info] <0.1467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.564 [info] <0.2524.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] to sync 2025-02-13 02:17:18.564 [info] <0.2525.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] to sync 2025-02-13 02:17:18.564 [info] <0.2527.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] to sync 2025-02-13 02:17:18.565 [info] <0.1282.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: complete 2025-02-13 02:17:18.565 [info] <0.1493.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: complete 2025-02-13 02:17:18.565 [info] <0.1640.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: complete 2025-02-13 02:17:18.576 [info] <0.1004.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: 94 messages to synchronise 2025-02-13 02:17:18.576 [info] <0.1004.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.577 [info] <0.2530.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] to sync 2025-02-13 02:17:18.577 [info] <0.1467.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: complete 2025-02-13 02:17:18.578 [info] <0.2532.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] to sync 2025-02-13 02:17:18.578 [info] <0.1004.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: complete 2025-02-13 02:17:18.579 [info] <0.1441.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.579 [info] <0.1441.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.602 [info] <0.1147.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.603 [info] <0.1147.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.607 [info] <0.1480.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.608 [info] <0.1480.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.609 [info] <0.1579.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.609 [info] <0.1579.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.613 [info] <0.1627.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.613 [info] <0.1557.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Synchronising: 0 messages to synchronise 2025-02-13 02:17:18.614 [info] <0.1627.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.614 [info] <0.1557.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Synchronising: batch size: 5 2025-02-13 02:17:18.614 [info] <0.2536.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Synchronising: mirrors ['contrail@cn-jenkins-deploy-platform-ansible-os-2728-1'] to sync 2025-02-13 02:17:18.614 [info] <0.1579.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Synchronising: complete 2025-02-13 02:17:18.615 [info] <0.2523.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:18.616 [info] <0.2526.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Synchronising: all slaves already synced 2025-02-13 02:17:19.071 [warning] lager_file_backend dropped 45 messages in the last second that exceeded the limit of 50 messages/sec 2025-02-13 02:17:43.300 [info] <0.2571.0> RabbitMQ is asked to stop... 2025-02-13 02:17:43.380 [info] <0.2571.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-13 02:17:43.380 [info] <0.2571.0> Stopping application 'rabbitmq_management' 2025-02-13 02:17:43.382 [warning] <0.765.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-13 02:17:43.383 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-13 02:17:43.383 [info] <0.2571.0> Stopping application 'amqp_client' 2025-02-13 02:17:43.385 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-13 02:17:43.385 [info] <0.2571.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-13 02:17:43.387 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-13 02:17:43.387 [info] <0.2571.0> Stopping application 'cowboy' 2025-02-13 02:17:43.389 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-13 02:17:43.389 [info] <0.2571.0> Stopping application 'cowlib' 2025-02-13 02:17:43.389 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-13 02:17:43.389 [info] <0.2571.0> Stopping application 'rabbitmq_management_agent' 2025-02-13 02:17:43.391 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-13 02:17:43.391 [info] <0.2571.0> Stopping application 'rabbit' 2025-02-13 02:17:43.391 [info] <0.305.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:17:43.391 [info] <0.757.0> stopped TCP listener on [::]:5673 2025-02-13 02:17:43.392 [error] <0.1909.0> Error on AMQP connection <0.1909.0> (10.0.0.35:36448 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1892.0> Error on AMQP connection <0.1892.0> (10.0.0.12:48312 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1661.0> Error on AMQP connection <0.1661.0> (10.0.0.12:48260 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1666.0> Error on AMQP connection <0.1666.0> (10.0.0.12:48262 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1734.0> Error on AMQP connection <0.1734.0> (10.0.0.35:36432 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1689.0> Error on AMQP connection <0.1689.0> (10.0.0.12:48264 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1717.0> Error on AMQP connection <0.1717.0> (10.0.0.46:50676 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1899.0> Error on AMQP connection <0.1899.0> (10.0.0.46:50680 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1737.0> Error on AMQP connection <0.1737.0> (10.0.0.35:36442 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1724.0> Error on AMQP connection <0.1724.0> (10.0.0.35:36406 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1885.0> Error on AMQP connection <0.1885.0> (10.0.0.12:48302 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1680.0> Error on AMQP connection <0.1680.0> (10.0.0.35:36382 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1713.0> Error on AMQP connection <0.1713.0> (10.0.0.12:48278 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1650.0> Error on AMQP connection <0.1650.0> (10.0.0.12:48230 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1656.0> Error on AMQP connection <0.1656.0> (10.0.0.46:50626 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1686.0> Error on AMQP connection <0.1686.0> (10.0.0.46:50638 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1698.0> Error on AMQP connection <0.1698.0> (10.0.0.35:36396 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1710.0> Error on AMQP connection <0.1710.0> (10.0.0.12:48270 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1683.0> Error on AMQP connection <0.1683.0> (10.0.0.35:36378 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1671.0> Error on AMQP connection <0.1671.0> (10.0.0.46:50656 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1727.0> Error on AMQP connection <0.1727.0> (10.0.0.35:36412 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1695.0> Error on AMQP connection <0.1695.0> (10.0.0.12:48248 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.392 [error] <0.1705.0> Error on AMQP connection <0.1705.0> (10.0.0.46:50662 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.394 [error] <0.1653.0> Error on AMQP connection <0.1653.0> (10.0.0.12:48246 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1692.0> Error on AMQP connection <0.1692.0> (10.0.0.46:50642 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.394 [error] <0.1647.0> Error on AMQP connection <0.1647.0> (10.0.0.46:50612 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.393 [error] <0.1731.0> Error on AMQP connection <0.1731.0> (10.0.0.35:36426 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.395 [error] <0.1673.0> Supervisor {<0.1673.0>,rabbit_channel_sup_sup} had child channel_sup started with rabbit_channel_sup:start_link() at undefined exit with reason shutdown in context shutdown_error 2025-02-13 02:17:43.398 [error] <0.1721.0> Error on AMQP connection <0.1721.0> (10.0.0.12:48290 -> 10.0.0.35:5673, vhost: '/', user: 'guest', state: running), channel 0: operation none caused a connection exception connection_forced: "broker forced connection closure with reason 'shutdown'" 2025-02-13 02:17:43.458 [info] <0.445.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' because the vhost is stopping 2025-02-13 02:17:43.525 [info] <0.464.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-13 02:17:43.530 [info] <0.464.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-13 02:18:20.684 [info] <0.8.0> Log file opened with Lager 2025-02-13 02:18:26.162 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-13 02:18:26.162 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-13 02:18:26.195 [info] <0.249.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-13 02:18:26.197 [info] <0.249.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 02:18:26.212 [info] <0.249.0> Running boot step pre_boot defined by app rabbit 2025-02-13 02:18:26.212 [info] <0.249.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-13 02:18:26.213 [info] <0.249.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-13 02:18:26.228 [info] <0.255.0> Memory high watermark set to 12637 MiB (13251077734 bytes) of 15796 MiB (16563847168 bytes) total 2025-02-13 02:18:26.239 [info] <0.257.0> Enabling free disk space monitoring 2025-02-13 02:18:26.239 [info] <0.257.0> Disk free limit set to 50MB 2025-02-13 02:18:26.246 [info] <0.249.0> Running boot step code_server_cache defined by app rabbit 2025-02-13 02:18:26.246 [info] <0.249.0> Running boot step file_handle_cache defined by app rabbit 2025-02-13 02:18:26.246 [info] <0.260.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-13 02:18:26.247 [info] <0.261.0> FHC read buffering: OFF 2025-02-13 02:18:26.247 [info] <0.261.0> FHC write buffering: ON 2025-02-13 02:18:26.247 [info] <0.249.0> Running boot step worker_pool defined by app rabbit 2025-02-13 02:18:26.247 [info] <0.250.0> Will use 4 processes for default worker pool 2025-02-13 02:18:26.247 [info] <0.250.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-13 02:18:26.247 [info] <0.249.0> Running boot step database defined by app rabbit 2025-02-13 02:18:26.248 [info] <0.249.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-02-13 02:18:26.248 [info] <0.249.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-02-13 02:18:26.248 [info] <0.249.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:18:26.248 [info] <0.249.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-02-13 02:18:26.248 [info] <0.249.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-02-13 02:18:26.248 [info] <0.249.0> Will wait for 31860 milliseconds before proceeding with registration... 2025-02-13 02:18:58.109 [info] <0.249.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-2728-1, contrail@cn-jenkins-deploy-platform-ansible-os-2728-2, contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 2025-02-13 02:18:58.109 [info] <0.249.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-2728-1, contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 2025-02-13 02:18:58.112 [info] <0.249.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' selected for auto-clustering 2025-02-13 02:18:58.162 [info] <0.249.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:18:58.242 [info] <0.249.0> Successfully synced tables from a peer 2025-02-13 02:18:58.244 [info] <0.249.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:18:58.244 [info] <0.249.0> Successfully synced tables from a peer 2025-02-13 02:18:58.283 [info] <0.249.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:18:58.283 [info] <0.249.0> Successfully synced tables from a peer 2025-02-13 02:18:58.284 [info] <0.249.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:18:58.285 [info] <0.249.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:18:58.286 [info] <0.249.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:18:58.286 [info] <0.249.0> Running boot step database_sync defined by app rabbit 2025-02-13 02:18:58.286 [info] <0.249.0> Running boot step feature_flags defined by app rabbit 2025-02-13 02:18:58.286 [info] <0.249.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-13 02:18:58.286 [info] <0.249.0> Running boot step external_infrastructure defined by app rabbit 2025-02-13 02:18:58.286 [info] <0.249.0> Running boot step rabbit_registry defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_event defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-13 02:18:58.287 [info] <0.249.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step kernel_ready defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-13 02:18:58.288 [info] <0.249.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-13 02:18:58.289 [info] <0.403.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-13 02:18:58.289 [info] <0.249.0> Running boot step guid_generator defined by app rabbit 2025-02-13 02:18:58.293 [info] <0.249.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-13 02:18:58.294 [info] <0.407.0> Starting rabbit_node_monitor 2025-02-13 02:18:58.294 [info] <0.249.0> Running boot step delegate_sup defined by app rabbit 2025-02-13 02:18:58.295 [info] <0.249.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-13 02:18:58.295 [info] <0.249.0> Running boot step core_initialized defined by app rabbit 2025-02-13 02:18:58.295 [info] <0.249.0> Running boot step upgrade_queues defined by app rabbit 2025-02-13 02:18:58.322 [info] <0.249.0> message_store upgrades: 1 to apply 2025-02-13 02:18:58.322 [info] <0.249.0> message_store upgrades: Applying rabbit_variable_queue:move_messages_to_vhost_store 2025-02-13 02:18:58.322 [info] <0.249.0> message_store upgrades: No durable queues found. Skipping message store migration 2025-02-13 02:18:58.322 [info] <0.249.0> message_store upgrades: Removing the old message store data 2025-02-13 02:18:58.323 [info] <0.249.0> message_store upgrades: All upgrades applied successfully 2025-02-13 02:18:58.354 [info] <0.249.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-13 02:18:58.354 [info] <0.249.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-13 02:18:58.354 [info] <0.249.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-13 02:18:58.354 [info] <0.249.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-13 02:18:58.355 [info] <0.249.0> Running boot step rabbit_policies defined by app rabbit 2025-02-13 02:18:58.355 [info] <0.249.0> Running boot step rabbit_policy defined by app rabbit 2025-02-13 02:18:58.356 [info] <0.249.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-13 02:18:58.356 [info] <0.249.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-13 02:18:58.356 [info] <0.249.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-13 02:18:58.356 [info] <0.249.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-13 02:18:58.356 [warning] <0.249.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-13 02:18:58.356 [info] <0.249.0> Management plugin: using rates mode 'basic' 2025-02-13 02:18:58.359 [info] <0.249.0> Running boot step recovery defined by app rabbit 2025-02-13 02:18:58.361 [info] <0.444.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-13 02:18:58.367 [info] <0.444.0> Starting message stores for vhost '/' 2025-02-13 02:18:58.367 [info] <0.448.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:18:58.368 [info] <0.444.0> Started message store of type transient for vhost '/' 2025-02-13 02:18:58.368 [info] <0.451.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:18:58.369 [warning] <0.451.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": rebuilding indices from scratch 2025-02-13 02:18:58.370 [info] <0.444.0> Started message store of type persistent for vhost '/' 2025-02-13 02:18:58.372 [info] <0.444.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.470.0> 2025-02-13 02:18:58.372 [info] <0.444.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.474.0> 2025-02-13 02:18:58.372 [info] <0.444.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.478.0> 2025-02-13 02:18:58.373 [info] <0.444.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.482.0> 2025-02-13 02:18:58.373 [info] <0.444.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.486.0> 2025-02-13 02:18:58.373 [info] <0.444.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.490.0> 2025-02-13 02:18:58.373 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.494.0> 2025-02-13 02:18:58.373 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.498.0> 2025-02-13 02:18:58.374 [info] <0.444.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.502.0> 2025-02-13 02:18:58.374 [info] <0.444.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.506.0> 2025-02-13 02:18:58.374 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.510.0> 2025-02-13 02:18:58.375 [info] <0.444.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.514.0> 2025-02-13 02:18:58.375 [info] <0.444.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.518.0> 2025-02-13 02:18:58.375 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.522.0> 2025-02-13 02:18:58.375 [info] <0.444.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.526.0> 2025-02-13 02:18:58.376 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.530.0> 2025-02-13 02:18:58.376 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.534.0> 2025-02-13 02:18:58.376 [info] <0.444.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.537.0> 2025-02-13 02:18:58.376 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.542.0> 2025-02-13 02:18:58.376 [info] <0.444.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.546.0> 2025-02-13 02:18:58.377 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.550.0> 2025-02-13 02:18:58.377 [info] <0.444.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.554.0> 2025-02-13 02:18:58.377 [info] <0.444.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.558.0> 2025-02-13 02:18:58.378 [info] <0.444.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.562.0> 2025-02-13 02:18:58.378 [info] <0.444.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.566.0> 2025-02-13 02:18:58.378 [info] <0.444.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.570.0> 2025-02-13 02:18:58.378 [info] <0.444.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.574.0> 2025-02-13 02:18:58.379 [info] <0.444.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.578.0> 2025-02-13 02:18:58.379 [info] <0.444.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.582.0> 2025-02-13 02:18:58.379 [info] <0.444.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.586.0> 2025-02-13 02:18:58.379 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.590.0> 2025-02-13 02:18:58.380 [info] <0.444.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.594.0> 2025-02-13 02:18:58.380 [info] <0.444.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.598.0> 2025-02-13 02:18:58.380 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.602.0> 2025-02-13 02:18:58.381 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.606.0> 2025-02-13 02:18:58.381 [info] <0.444.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.610.0> 2025-02-13 02:18:58.381 [info] <0.444.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.614.0> 2025-02-13 02:18:58.382 [info] <0.249.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-13 02:18:58.382 [info] <0.249.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-13 02:18:58.382 [info] <0.249.0> Asked to import definitions. Acting user: rmq-internal 2025-02-13 02:18:58.382 [info] <0.249.0> Importing users... 2025-02-13 02:18:58.419 [info] <0.249.0> Setting user tags for user 'guest' to [administrator] 2025-02-13 02:18:58.486 [info] <0.249.0> Importing vhosts... 2025-02-13 02:18:58.486 [info] <0.249.0> Importing user permissions... 2025-02-13 02:18:58.486 [info] <0.249.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-13 02:18:58.612 [info] <0.249.0> Importing topic permissions... 2025-02-13 02:18:58.612 [info] <0.249.0> Importing parameters... 2025-02-13 02:18:58.612 [info] <0.249.0> Importing global parameters... 2025-02-13 02:18:58.612 [info] <0.249.0> Importing policies... 2025-02-13 02:18:58.635 [info] <0.249.0> Importing queues... 2025-02-13 02:18:58.635 [info] <0.249.0> Importing exchanges... 2025-02-13 02:18:58.635 [info] <0.249.0> Importing bindings... 2025-02-13 02:18:58.635 [info] <0.249.0> Running boot step empty_db_check defined by app rabbit 2025-02-13 02:18:58.635 [info] <0.249.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-13 02:18:58.635 [info] <0.249.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-13 02:18:58.636 [info] <0.249.0> Running boot step background_gc defined by app rabbit 2025-02-13 02:18:58.636 [info] <0.249.0> Running boot step connection_tracking defined by app rabbit 2025-02-13 02:18:58.642 [info] <0.249.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:18:58.643 [info] <0.249.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:18:58.643 [info] <0.249.0> Running boot step routing_ready defined by app rabbit 2025-02-13 02:18:58.643 [info] <0.249.0> Running boot step pre_flight defined by app rabbit 2025-02-13 02:18:58.643 [info] <0.249.0> Running boot step notify_cluster defined by app rabbit 2025-02-13 02:18:58.643 [info] <0.249.0> Running boot step networking defined by app rabbit 2025-02-13 02:18:58.645 [info] <0.407.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:18:58.653 [info] <0.751.0> started TCP listener on [::]:5673 2025-02-13 02:18:58.654 [info] <0.249.0> Running boot step cluster_name defined by app rabbit 2025-02-13 02:18:58.654 [info] <0.249.0> Running boot step direct_client defined by app rabbit 2025-02-13 02:18:58.654 [info] <0.249.0> Running boot step os_signal_handler defined by app rabbit 2025-02-13 02:18:58.654 [info] <0.753.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-13 02:18:58.771 [info] <0.407.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 02:18:58.819 [info] <0.879.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-13 02:18:58.820 [info] <0.985.0> Statistics database started. 2025-02-13 02:18:58.820 [info] <0.984.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-13 02:18:58.821 [notice] <0.114.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-13 02:18:58.952 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_web_dispatch * rabbitmq_management_agent 2025-02-13 02:19:00.724 [info] <0.1010.0> RabbitMQ is asked to stop... 2025-02-13 02:19:00.862 [info] <0.1010.0> Stopping RabbitMQ applications and their dependencies in the following order: rabbitmq_management amqp_client rabbitmq_web_dispatch cowboy cowlib rabbitmq_management_agent rabbit mnesia rabbit_common sysmon_handler os_mon 2025-02-13 02:19:00.862 [info] <0.1010.0> Stopping application 'rabbitmq_management' 2025-02-13 02:19:00.865 [warning] <0.875.0> RabbitMQ HTTP listener registry could not find context rabbitmq_management_tls 2025-02-13 02:19:00.866 [info] <0.1010.0> Stopping application 'amqp_client' 2025-02-13 02:19:00.866 [info] <0.43.0> Application rabbitmq_management exited with reason: stopped 2025-02-13 02:19:00.868 [info] <0.1010.0> Stopping application 'rabbitmq_web_dispatch' 2025-02-13 02:19:00.868 [info] <0.43.0> Application amqp_client exited with reason: stopped 2025-02-13 02:19:00.869 [info] <0.1010.0> Stopping application 'cowboy' 2025-02-13 02:19:00.869 [info] <0.43.0> Application rabbitmq_web_dispatch exited with reason: stopped 2025-02-13 02:19:00.871 [info] <0.1010.0> Stopping application 'cowlib' 2025-02-13 02:19:00.871 [info] <0.43.0> Application cowboy exited with reason: stopped 2025-02-13 02:19:00.871 [info] <0.43.0> Application cowlib exited with reason: stopped 2025-02-13 02:19:00.871 [info] <0.1010.0> Stopping application 'rabbitmq_management_agent' 2025-02-13 02:19:00.873 [info] <0.43.0> Application rabbitmq_management_agent exited with reason: stopped 2025-02-13 02:19:00.873 [info] <0.1010.0> Stopping application 'rabbit' 2025-02-13 02:19:00.873 [info] <0.249.0> Will unregister with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:19:00.874 [info] <0.751.0> stopped TCP listener on [::]:5673 2025-02-13 02:19:00.875 [info] <0.432.0> Closing all connections in vhost '/' on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' because the vhost is stopping 2025-02-13 02:19:00.876 [info] <0.451.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' 2025-02-13 02:19:00.919 [info] <0.451.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent' is stopped 2025-02-13 02:19:00.920 [info] <0.448.0> Stopping message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' 2025-02-13 02:19:00.939 [info] <0.448.0> Message store for directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L/msg_store_transient' is stopped 2025-02-13 02:19:00.972 [info] <0.1010.0> Stopping application 'mnesia' 2025-02-13 02:19:00.972 [info] <0.43.0> Application rabbit exited with reason: stopped 2025-02-13 02:19:00.980 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 02:19:00.980 [info] <0.1010.0> Stopping application 'rabbit_common' 2025-02-13 02:19:00.980 [info] <0.43.0> Application rabbit_common exited with reason: stopped 2025-02-13 02:19:00.980 [info] <0.1010.0> Stopping application 'sysmon_handler' 2025-02-13 02:19:00.982 [info] <0.43.0> Application sysmon_handler exited with reason: stopped 2025-02-13 02:19:00.982 [info] <0.1010.0> Stopping application 'os_mon' 2025-02-13 02:19:00.985 [info] <0.43.0> Application os_mon exited with reason: stopped 2025-02-13 02:19:00.985 [info] <0.1010.0> Successfully stopped RabbitMQ and its dependencies 2025-02-13 02:19:00.986 [info] <0.1010.0> Halting Erlang VM with the following applications: jsx ranch ssl public_key asn1 observer_cli xmerl tools credentials_obfuscation crypto stdout_formatter recon inets lager goldrush compiler syntax_tools sasl stdlib kernel 2025-02-13 02:19:11.779 [info] <0.8.0> Log file opened with Lager 2025-02-13 02:19:13.988 [info] <0.8.0> Feature flags: list of feature flags found: 2025-02-13 02:19:13.988 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-02-13 02:19:14.079 [info] <0.43.0> Application mnesia exited with reason: stopped 2025-02-13 02:19:14.128 [info] <0.298.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-02-13 02:19:14.129 [info] <0.298.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2 2025-02-13 02:19:14.144 [info] <0.298.0> Running boot step pre_boot defined by app rabbit 2025-02-13 02:19:14.144 [info] <0.298.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-02-13 02:19:14.144 [info] <0.298.0> Running boot step rabbit_alarm defined by app rabbit 2025-02-13 02:19:14.150 [info] <0.323.0> Memory high watermark set to 12637 MiB (13251077734 bytes) of 15796 MiB (16563847168 bytes) total 2025-02-13 02:19:14.156 [info] <0.332.0> Enabling free disk space monitoring 2025-02-13 02:19:14.156 [info] <0.332.0> Disk free limit set to 50MB 2025-02-13 02:19:14.161 [info] <0.298.0> Running boot step code_server_cache defined by app rabbit 2025-02-13 02:19:14.161 [info] <0.298.0> Running boot step file_handle_cache defined by app rabbit 2025-02-13 02:19:14.162 [info] <0.354.0> FHC read buffering: OFF 2025-02-13 02:19:14.162 [info] <0.353.0> Limiting to approx 65436 file handles (58890 sockets) 2025-02-13 02:19:14.162 [info] <0.354.0> FHC write buffering: ON 2025-02-13 02:19:14.162 [info] <0.298.0> Running boot step worker_pool defined by app rabbit 2025-02-13 02:19:14.162 [info] <0.299.0> Will use 4 processes for default worker pool 2025-02-13 02:19:14.162 [info] <0.299.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-02-13 02:19:14.163 [info] <0.298.0> Running boot step database defined by app rabbit 2025-02-13 02:19:14.173 [info] <0.298.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:19:14.192 [info] <0.298.0> Successfully synced tables from a peer 2025-02-13 02:19:14.200 [info] <0.298.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:19:14.200 [info] <0.298.0> Successfully synced tables from a peer 2025-02-13 02:19:14.232 [info] <0.298.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-02-13 02:19:14.232 [info] <0.298.0> Successfully synced tables from a peer 2025-02-13 02:19:14.232 [info] <0.298.0> Will register with peer discovery backend rabbit_peer_discovery_classic_config 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step database_sync defined by app rabbit 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step feature_flags defined by app rabbit 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step codec_correctness_check defined by app rabbit 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step external_infrastructure defined by app rabbit 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step rabbit_registry defined by app rabbit 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step rabbit_auth_mechanism_cr_demo defined by app rabbit 2025-02-13 02:19:14.232 [info] <0.298.0> Running boot step rabbit_queue_location_random defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_event defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_auth_mechanism_amqplain defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_auth_mechanism_plain defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_exchange_type_direct defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_exchange_type_fanout defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_exchange_type_headers defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_exchange_type_topic defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_mirror_queue_mode_all defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_mirror_queue_mode_exactly defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_mirror_queue_mode_nodes defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_priority_queue defined by app rabbit 2025-02-13 02:19:14.233 [info] <0.298.0> Priority queues enabled, real BQ is rabbit_variable_queue 2025-02-13 02:19:14.233 [info] <0.298.0> Running boot step rabbit_queue_location_client_local defined by app rabbit 2025-02-13 02:19:14.234 [info] <0.298.0> Running boot step rabbit_queue_location_min_masters defined by app rabbit 2025-02-13 02:19:14.234 [info] <0.298.0> Running boot step kernel_ready defined by app rabbit 2025-02-13 02:19:14.234 [info] <0.298.0> Running boot step rabbit_sysmon_minder defined by app rabbit 2025-02-13 02:19:14.234 [info] <0.298.0> Running boot step rabbit_epmd_monitor defined by app rabbit 2025-02-13 02:19:14.238 [info] <0.409.0> epmd monitor knows us, inter-node communication (distribution) port: 25673 2025-02-13 02:19:14.238 [info] <0.298.0> Running boot step guid_generator defined by app rabbit 2025-02-13 02:19:14.258 [info] <0.298.0> Running boot step rabbit_node_monitor defined by app rabbit 2025-02-13 02:19:14.259 [info] <0.415.0> Starting rabbit_node_monitor 2025-02-13 02:19:14.260 [info] <0.298.0> Running boot step delegate_sup defined by app rabbit 2025-02-13 02:19:14.260 [info] <0.298.0> Running boot step rabbit_memory_monitor defined by app rabbit 2025-02-13 02:19:14.260 [info] <0.298.0> Running boot step core_initialized defined by app rabbit 2025-02-13 02:19:14.260 [info] <0.298.0> Running boot step upgrade_queues defined by app rabbit 2025-02-13 02:19:14.290 [info] <0.298.0> Running boot step rabbit_connection_tracking defined by app rabbit 2025-02-13 02:19:14.290 [info] <0.298.0> Running boot step rabbit_connection_tracking_handler defined by app rabbit 2025-02-13 02:19:14.290 [info] <0.298.0> Running boot step rabbit_exchange_parameters defined by app rabbit 2025-02-13 02:19:14.290 [info] <0.298.0> Running boot step rabbit_mirror_queue_misc defined by app rabbit 2025-02-13 02:19:14.291 [info] <0.298.0> Running boot step rabbit_policies defined by app rabbit 2025-02-13 02:19:14.292 [info] <0.298.0> Running boot step rabbit_policy defined by app rabbit 2025-02-13 02:19:14.292 [info] <0.298.0> Running boot step rabbit_queue_location_validator defined by app rabbit 2025-02-13 02:19:14.292 [info] <0.298.0> Running boot step rabbit_vhost_limit defined by app rabbit 2025-02-13 02:19:14.292 [info] <0.298.0> Running boot step rabbit_mgmt_reset_handler defined by app rabbitmq_management 2025-02-13 02:19:14.292 [info] <0.298.0> Running boot step rabbit_mgmt_db_handler defined by app rabbitmq_management_agent 2025-02-13 02:19:14.292 [warning] <0.298.0> force_fine_statistics set to true; ignored. Replaced by {rates_mode, none} in the rabbitmq_management application. 2025-02-13 02:19:14.292 [info] <0.298.0> Management plugin: using rates mode 'basic' 2025-02-13 02:19:14.295 [info] <0.298.0> Running boot step recovery defined by app rabbit 2025-02-13 02:19:14.296 [info] <0.452.0> Making sure data directory '/var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-2728-2/msg_stores/vhosts/628WB79CIFDYO9LJI6DKMI09L' for vhost '/' exists 2025-02-13 02:19:14.300 [info] <0.452.0> Starting message stores for vhost '/' 2025-02-13 02:19:14.301 [info] <0.456.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_transient": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:19:14.309 [info] <0.452.0> Started message store of type transient for vhost '/' 2025-02-13 02:19:14.309 [info] <0.459.0> Message store "628WB79CIFDYO9LJI6DKMI09L/msg_store_persistent": using rabbit_msg_store_ets_index to provide index 2025-02-13 02:19:14.333 [info] <0.452.0> Started message store of type persistent for vhost '/' 2025-02-13 02:19:14.334 [info] <0.452.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.478.0> 2025-02-13 02:19:14.335 [info] <0.452.0> Mirrored queue 'job_status_consumer.dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.482.0> 2025-02-13 02:19:14.335 [info] <0.452.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.486.0> 2025-02-13 02:19:14.335 [info] <0.452.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.490.0> 2025-02-13 02:19:14.335 [info] <0.452.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.494.0> 2025-02-13 02:19:14.336 [info] <0.452.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.498.0> 2025-02-13 02:19:14.336 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.502.0> 2025-02-13 02:19:14.336 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.506.0> 2025-02-13 02:19:14.336 [info] <0.452.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.510.0> 2025-02-13 02:19:14.336 [info] <0.452.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-1..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.514.0> 2025-02-13 02:19:14.337 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.518.0> 2025-02-13 02:19:14.337 [info] <0.452.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-2..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.522.0> 2025-02-13 02:19:14.337 [info] <0.452.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.526.0> 2025-02-13 02:19:14.337 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.530.0> 2025-02-13 02:19:14.338 [info] <0.452.0> Mirrored queue 'job_request_consumer' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.534.0> 2025-02-13 02:19:14.338 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.538.0> 2025-02-13 02:19:14.338 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.542.0> 2025-02-13 02:19:14.338 [info] <0.452.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.546.0> 2025-02-13 02:19:14.339 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..config_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.550.0> 2025-02-13 02:19:14.339 [info] <0.452.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.554.0> 2025-02-13 02:19:14.339 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.558.0> 2025-02-13 02:19:14.339 [info] <0.452.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.562.0> 2025-02-13 02:19:14.340 [info] <0.452.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.566.0> 2025-02-13 02:19:14.340 [info] <0.452.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-3..dummy' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.570.0> 2025-02-13 02:19:14.340 [info] <0.452.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..tftp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.574.0> 2025-02-13 02:19:14.340 [info] <0.452.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.578.0> 2025-02-13 02:19:14.341 [info] <0.452.0> Mirrored queue 'device_manager_ztp.ztp_queue' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.582.0> 2025-02-13 02:19:14.341 [info] <0.452.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.586.0> 2025-02-13 02:19:14.341 [info] <0.452.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.590.0> 2025-02-13 02:19:14.341 [info] <0.452.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.594.0> 2025-02-13 02:19:14.342 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.598.0> 2025-02-13 02:19:14.342 [info] <0.452.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.602.0> 2025-02-13 02:19:14.342 [info] <0.452.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.606.0> 2025-02-13 02:19:14.343 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.610.0> 2025-02-13 02:19:14.344 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.614.0> 2025-02-13 02:19:14.344 [info] <0.452.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-1.-8082-0' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.618.0> 2025-02-13 02:19:14.344 [info] <0.452.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Adding mirror on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-2': <0.622.0> 2025-02-13 02:19:14.345 [info] <0.298.0> Running boot step load_definitions defined by app rabbitmq_management 2025-02-13 02:19:14.345 [info] <0.298.0> Applying definitions from /etc/rabbitmq/definitions.json 2025-02-13 02:19:14.346 [info] <0.298.0> Asked to import definitions. Acting user: rmq-internal 2025-02-13 02:19:14.346 [info] <0.298.0> Importing users... 2025-02-13 02:19:14.361 [info] <0.298.0> Setting user tags for user 'guest' to [administrator] 2025-02-13 02:19:14.399 [info] <0.298.0> Importing vhosts... 2025-02-13 02:19:14.399 [info] <0.298.0> Importing user permissions... 2025-02-13 02:19:14.399 [info] <0.298.0> Setting permissions for 'guest' in '/' to '.*', '.*', '.*' 2025-02-13 02:19:14.445 [info] <0.298.0> Importing topic permissions... 2025-02-13 02:19:14.445 [info] <0.298.0> Importing parameters... 2025-02-13 02:19:14.445 [info] <0.298.0> Importing global parameters... 2025-02-13 02:19:14.445 [info] <0.298.0> Importing policies... 2025-02-13 02:19:14.532 [info] <0.298.0> Importing queues... 2025-02-13 02:19:14.532 [info] <0.298.0> Importing exchanges... 2025-02-13 02:19:14.532 [info] <0.298.0> Importing bindings... 2025-02-13 02:19:14.533 [info] <0.298.0> Running boot step empty_db_check defined by app rabbit 2025-02-13 02:19:14.533 [info] <0.298.0> Running boot step rabbit_looking_glass defined by app rabbit 2025-02-13 02:19:14.533 [info] <0.298.0> Running boot step rabbit_core_metrics_gc defined by app rabbit 2025-02-13 02:19:14.533 [info] <0.298.0> Running boot step background_gc defined by app rabbit 2025-02-13 02:19:14.533 [info] <0.298.0> Running boot step connection_tracking defined by app rabbit 2025-02-13 02:19:14.535 [info] <0.298.0> Setting up a table for connection tracking on this node: 'tracked_connection_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:19:14.539 [info] <0.298.0> Setting up a table for per-vhost connection counting on this node: 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-2728-2' 2025-02-13 02:19:14.539 [info] <0.298.0> Running boot step routing_ready defined by app rabbit 2025-02-13 02:19:14.540 [info] <0.298.0> Running boot step pre_flight defined by app rabbit 2025-02-13 02:19:14.540 [info] <0.298.0> Running boot step notify_cluster defined by app rabbit 2025-02-13 02:19:14.540 [info] <0.298.0> Running boot step networking defined by app rabbit 2025-02-13 02:19:14.542 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-1' up 2025-02-13 02:19:14.543 [info] <0.759.0> started TCP listener on [::]:5673 2025-02-13 02:19:14.543 [info] <0.298.0> Running boot step cluster_name defined by app rabbit 2025-02-13 02:19:14.543 [info] <0.298.0> Running boot step direct_client defined by app rabbit 2025-02-13 02:19:14.543 [info] <0.298.0> Running boot step os_signal_handler defined by app rabbit 2025-02-13 02:19:14.543 [info] <0.761.0> Swapping OS signal event handler (erl_signal_server) for our own 2025-02-13 02:19:14.656 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:19:14.693 [info] <0.887.0> Management plugin: HTTP (non-TLS) listener started on port 15673 2025-02-13 02:19:14.693 [info] <0.993.0> Statistics database started. 2025-02-13 02:19:14.693 [info] <0.992.0> Starting worker pool 'management_worker_pool' with 3 processes in it 2025-02-13 02:19:14.693 [notice] <0.106.0> Changed loghwm of /var/log/contrail/config-database-rabbitmq/rabbitmq.log to 50 2025-02-13 02:19:14.827 [info] <0.8.0> Server startup complete; 3 plugins started. * rabbitmq_management * rabbitmq_management_agent * rabbitmq_web_dispatch 2025-02-13 02:19:22.536 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' down 2025-02-13 02:19:22.547 [info] <0.415.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 listeners: the node is already back 2025-02-13 02:19:22.562 [info] <0.415.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' down: connection_closed 2025-02-13 02:19:22.584 [info] <0.510.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.617 [info] <0.478.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.617 [info] <0.578.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.633 [info] <0.594.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.656 [info] <0.590.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.677 [info] <0.486.0> Mirrored queue 'schema_transformer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.677 [info] <0.490.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-2.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.678 [info] <0.538.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.681 [info] <0.498.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.683 [info] <0.562.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-1' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.684 [info] <0.502.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-1..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.698 [info] <0.566.0> Mirrored queue 'svc_monitor.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:22.698 [info] <0.546.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:19:55.653 [info] <0.415.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:20:33.950 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:20:35.251 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' down 2025-02-13 02:20:35.261 [info] <0.415.0> Keeping contrail@cn-jenkins-deploy-platform-ansible-os-2728-3 listeners: the node is already back 2025-02-13 02:20:35.369 [info] <0.510.0> Mirrored queue 'contrail-control.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.369 [info] <0.622.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.371 [info] <0.534.0> Mirrored queue 'job_request_consumer' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.371 [info] <0.590.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-2' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.372 [info] <0.1044.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-2..dummy' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.373 [info] <0.606.0> Mirrored queue 'contrail-collector.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.373 [info] <0.558.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-2.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-2.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.373 [info] <0.578.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.375 [info] <0.554.0> Mirrored queue 'job_abort_consumer.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.375 [info] <0.526.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-3.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.376 [info] <0.542.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-snmp-collector:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.377 [info] <0.478.0> Mirrored queue 'contrail-dns.cn-jenkins-deploy-platform-ansible-os-2728-3' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.378 [info] <0.498.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.378 [info] <0.1071.0> Mirrored queue 'amqp_request.cn-jenkins-deploy-platform-ansible-os-2728-3..dummy' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.379 [info] <0.546.0> Mirrored queue 'device_manager.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.380 [info] <0.530.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-1.:contrail-alarm-gen:0.cn-jenkins-deploy-platform-ansible-os-2728-1.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.381 [info] <0.538.0> Mirrored queue 'cn-jenkins-deploy-platform-ansible-os-2728-3.:contrail-topology:0.cn-jenkins-deploy-platform-ansible-os-2728-3.' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.381 [info] <0.550.0> Mirrored queue 'device_manager_ztp.cn-jenkins-deploy-platform-ansible-os-2728-3..config_queue' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:35.382 [info] <0.618.0> Mirrored queue 'vnc_config.cn-jenkins-deploy-platform-ansible-os-2728-1.-8082-0' in vhost '/': Slave saw deaths of mirrors 2025-02-13 02:20:36.273 [info] <0.415.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' down: connection_closed 2025-02-13 02:20:42.296 [info] <0.415.0> node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up 2025-02-13 02:20:44.348 [info] <0.415.0> rabbit on node 'contrail@cn-jenkins-deploy-platform-ansible-os-2728-3' up