2025-05-01 00:42:03.770 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:42:06.461 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:42:06.461 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:42:06.490 [info] <0.238.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-05-01 00:42:06.490 [info] <0.238.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-3251-3 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3 2025-05-01 00:42:06.505 [info] <0.238.0> Running boot step pre_boot defined by app rabbit 2025-05-01 00:42:06.505 [info] <0.238.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-05-01 00:42:06.505 [info] <0.238.0> Running boot step rabbit_alarm defined by app rabbit 2025-05-01 00:42:06.510 [info] <0.244.0> Memory high watermark set to 12637 MiB (13251084288 bytes) of 15796 MiB (16563855360 bytes) total 2025-05-01 00:42:06.518 [info] <0.246.0> Enabling free disk space monitoring 2025-05-01 00:42:06.518 [info] <0.246.0> Disk free limit set to 50MB 2025-05-01 00:42:06.524 [info] <0.238.0> Running boot step code_server_cache defined by app rabbit 2025-05-01 00:42:06.524 [info] <0.238.0> Running boot step file_handle_cache defined by app rabbit 2025-05-01 00:42:06.525 [info] <0.249.0> Limiting to approx 65436 file handles (58890 sockets) 2025-05-01 00:42:06.525 [info] <0.250.0> FHC read buffering: OFF 2025-05-01 00:42:06.525 [info] <0.250.0> FHC write buffering: ON 2025-05-01 00:42:06.525 [info] <0.238.0> Running boot step worker_pool defined by app rabbit 2025-05-01 00:42:06.525 [info] <0.239.0> Will use 4 processes for default worker pool 2025-05-01 00:42:06.525 [info] <0.239.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-05-01 00:42:06.526 [info] <0.238.0> Running boot step database defined by app rabbit 2025-05-01 00:42:06.526 [info] <0.238.0> Node database directory at /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3 is empty. Assuming we need to join an existing cluster or initialise from scratch... 2025-05-01 00:42:06.526 [info] <0.238.0> Configured peer discovery backend: rabbit_peer_discovery_classic_config 2025-05-01 00:42:06.526 [info] <0.238.0> Will try to lock with peer discovery backend rabbit_peer_discovery_classic_config 2025-05-01 00:42:06.526 [info] <0.238.0> Peer discovery backend does not support locking, falling back to randomized delay 2025-05-01 00:42:06.526 [info] <0.238.0> Peer discovery backend rabbit_peer_discovery_classic_config supports registration. 2025-05-01 00:42:06.526 [info] <0.238.0> Will wait for 58580 milliseconds before proceeding with registration... 2025-05-01 00:42:56.673 [info] <0.294.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2025-05-01 00:43:05.107 [info] <0.238.0> All discovered existing cluster peers: contrail@cn-jenkins-deploy-platform-ansible-os-3251-1, contrail@cn-jenkins-deploy-platform-ansible-os-3251-2, contrail@cn-jenkins-deploy-platform-ansible-os-3251-3 2025-05-01 00:43:05.107 [info] <0.238.0> Peer nodes we can cluster with: contrail@cn-jenkins-deploy-platform-ansible-os-3251-1, contrail@cn-jenkins-deploy-platform-ansible-os-3251-2 2025-05-01 00:43:05.108 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-3251-1: {error,tables_not_present} 2025-05-01 00:43:05.109 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-3251-2: {error,tables_not_present} 2025-05-01 00:43:05.109 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 9 retries left... 2025-05-01 00:43:05.610 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-3251-1: {error,tables_not_present} 2025-05-01 00:43:05.611 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-3251-2: {error,tables_not_present} 2025-05-01 00:43:05.611 [error] <0.238.0> Trying to join discovered peers failed. Will retry after a delay of 500 ms, 8 retries left... 2025-05-01 00:43:06.116 [warning] <0.238.0> Could not auto-cluster with node contrail@cn-jenkins-deploy-platform-ansible-os-3251-1: {error,tables_not_present} 2025-05-01 00:43:06.118 [info] <0.238.0> Node 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' selected for auto-clustering 2025-05-01 00:43:06.131 [info] <0.238.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-05-01 00:43:06.131 [info] <0.238.0> Successfully synced tables from a peer 2025-05-01 00:43:06.286 [error] <0.237.0> CRASH REPORT Process <0.237.0> with 0 neighbours exited with reason: no match of right hand value {aborted,{system_limit,rabbit_durable_exchange,{'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3',none_active}}} in rabbit_table:create_local_copy/2 line 202 in application_master:init/4 line 138 2025-05-01 00:43:06.287 [info] <0.43.0> Application rabbit exited with reason: no match of right hand value {aborted,{system_limit,rabbit_durable_exchange,{'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3',none_active}}} in rabbit_table:create_local_copy/2 line 202 2025-05-01 00:43:18.423 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:43:20.343 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:43:20.343 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:43:20.393 [info] <0.290.0> Starting RabbitMQ 3.7.28 on Erlang 21.3.8.21 Copyright (c) 2007-2020 Pivotal Software, Inc. Licensed under the MPL. See https://www.rabbitmq.com/ 2025-05-01 00:43:20.394 [info] <0.290.0> node : contrail@cn-jenkins-deploy-platform-ansible-os-3251-3 home dir : /var/lib/rabbitmq config file(s) : /etc/rabbitmq/rabbitmq.config cookie hash : esZsDxSN6VGbi9JkMSxNZA== log(s) : /var/log/contrail/config-database-rabbitmq/rabbitmq.log : /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log database dir : /var/lib/rabbitmq/mnesia/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3 2025-05-01 00:43:20.408 [info] <0.290.0> Running boot step pre_boot defined by app rabbit 2025-05-01 00:43:20.408 [info] <0.290.0> Running boot step rabbit_core_metrics defined by app rabbit 2025-05-01 00:43:20.409 [info] <0.290.0> Running boot step rabbit_alarm defined by app rabbit 2025-05-01 00:43:20.413 [info] <0.296.0> Memory high watermark set to 12637 MiB (13251084288 bytes) of 15796 MiB (16563855360 bytes) total 2025-05-01 00:43:20.418 [info] <0.298.0> Enabling free disk space monitoring 2025-05-01 00:43:20.418 [info] <0.298.0> Disk free limit set to 50MB 2025-05-01 00:43:20.422 [info] <0.290.0> Running boot step code_server_cache defined by app rabbit 2025-05-01 00:43:20.422 [info] <0.290.0> Running boot step file_handle_cache defined by app rabbit 2025-05-01 00:43:20.423 [info] <0.301.0> Limiting to approx 65436 file handles (58890 sockets) 2025-05-01 00:43:20.423 [info] <0.302.0> FHC read buffering: OFF 2025-05-01 00:43:20.423 [info] <0.302.0> FHC write buffering: ON 2025-05-01 00:43:20.423 [info] <0.290.0> Running boot step worker_pool defined by app rabbit 2025-05-01 00:43:20.423 [info] <0.291.0> Will use 4 processes for default worker pool 2025-05-01 00:43:20.423 [info] <0.291.0> Starting worker pool 'worker_pool' with 4 processes in it 2025-05-01 00:43:20.423 [info] <0.290.0> Running boot step database defined by app rabbit 2025-05-01 00:43:20.426 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 9 retries left 2025-05-01 00:43:50.427 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:43:50.427 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 8 retries left 2025-05-01 00:44:01.042 [info] <0.352.0> RabbitMQ hasn't finished starting yet. Waiting for startup to finish before stopping... 2025-05-01 00:44:20.428 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:44:20.428 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 7 retries left 2025-05-01 00:44:50.429 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:44:50.429 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 6 retries left 2025-05-01 00:45:20.430 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:45:20.430 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 5 retries left 2025-05-01 00:45:50.431 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:45:50.432 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 4 retries left 2025-05-01 00:46:20.432 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:46:20.432 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 3 retries left 2025-05-01 00:46:50.433 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:46:50.434 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 2 retries left 2025-05-01 00:47:20.434 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:47:20.434 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 1 retries left 2025-05-01 00:47:50.435 [warning] <0.290.0> Error while waiting for Mnesia tables: {timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]} 2025-05-01 00:47:50.435 [info] <0.290.0> Waiting for Mnesia tables for 30000 ms, 0 retries left 2025-05-01 00:48:20.436 [error] <0.289.0> CRASH REPORT Process <0.289.0> with 0 neighbours exited with reason: {{timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]},{rabbit,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:48:20.437 [info] <0.43.0> Application rabbit exited with reason: {{timeout_waiting_for_tables,[rabbit_durable_exchange,rabbit_exchange,rabbit_exchange_serial,rabbit_runtime_parameters,rabbit_durable_queue,rabbit_queue,gm_group,mirrored_sup_childspec]},{rabbit,start,[normal,[]]}} 2025-05-01 00:48:37.555 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:48:40.591 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:48:40.591 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:48:40.706 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60520_705002") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:48:50.706 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:48:50.707 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3995493774.1432748033.245652>} ** Reason for termination == ** killed 2025-05-01 00:48:50.707 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:48:50.707 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:48:50.708 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:48:50.708 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:48:50.708 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:48:50.708 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:48:50.709 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:48:50.709 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:49:32.673 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:49:35.872 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:49:35.872 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:49:35.915 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:49:35.980 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60575_978943") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:49:45.980 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:49:45.980 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1095988468.3312058369.146167>} ** Reason for termination == ** killed 2025-05-01 00:49:45.980 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:49:45.980 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:49:45.980 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:49:45.980 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:49:45.981 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:49:45.981 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:49:45.981 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:49:45.983 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:50:34.631 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:50:37.338 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:50:37.338 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:50:37.365 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:50:37.422 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60637_421805") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:50:47.423 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:50:47.423 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2673579664.2775187457.86557>} ** Reason for termination == ** killed 2025-05-01 00:50:47.423 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:50:47.424 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:50:47.424 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:50:47.424 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:50:47.424 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:50:47.424 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:50:47.424 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:50:47.424 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:51:32.676 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:51:36.056 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:51:36.056 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:51:36.094 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:51:36.158 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60696_157398") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:51:46.158 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:51:46.159 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2377032492.896925697.163094>} ** Reason for termination == ** killed 2025-05-01 00:51:46.159 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:51:46.159 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:51:46.159 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:51:46.160 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:51:46.160 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:51:46.160 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:51:46.160 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:51:46.160 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:52:39.539 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:52:42.256 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:52:42.256 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:52:42.295 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:52:42.362 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60762_360993") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:52:52.363 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:52:52.363 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.529340272.1970143233.148529>} ** Reason for termination == ** killed 2025-05-01 00:52:52.364 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:52:52.364 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:52:52.364 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:52:52.364 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:52:52.364 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:52:52.364 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:52:52.365 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:52:52.365 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:53:44.399 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:53:49.430 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:53:49.430 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:53:49.499 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:53:49.596 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60829_594883") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:53:59.595 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:53:59.596 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.385118235.2238578689.155580>} ** Reason for termination == ** killed 2025-05-01 00:53:59.596 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:53:59.596 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:53:59.596 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:53:59.596 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:53:59.596 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:53:59.596 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:53:59.597 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:53:59.597 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:54:53.243 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:54:56.116 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:54:56.116 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:54:56.152 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:54:56.222 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60896_220333") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:55:06.221 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:55:06.223 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2190331376.3581018113.42509>} ** Reason for termination == ** killed 2025-05-01 00:55:06.223 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:55:06.223 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:55:06.224 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:55:06.224 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:55:06.224 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:55:06.224 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:55:06.225 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:55:06.225 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:55:55.726 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:55:58.582 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:55:58.582 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:55:58.620 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:55:58.704 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_60958_704023") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:56:08.705 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:56:08.705 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2761516280.3044933633.53849>} ** Reason for termination == ** killed 2025-05-01 00:56:08.705 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:56:08.705 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:56:08.705 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:56:08.705 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:56:08.706 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:56:08.706 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:56:08.706 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:56:08.706 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:56:56.999 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:56:59.715 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:56:59.716 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:56:59.755 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:56:59.824 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61019_823276") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:57:09.824 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:57:09.825 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4217860512.2507538433.54650>} ** Reason for termination == ** killed 2025-05-01 00:57:09.825 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:57:09.825 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:57:09.826 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:57:09.826 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:57:09.826 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:57:09.826 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:57:09.826 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:57:09.826 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:58:02.066 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:58:05.389 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:58:05.389 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:58:05.458 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:58:05.531 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61085_530640") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:58:15.532 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:58:15.532 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4249683076.2507538433.232648>} ** Reason for termination == ** killed 2025-05-01 00:58:15.532 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:58:15.532 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:58:15.533 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:58:15.533 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 00:58:15.533 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:58:15.533 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:58:15.533 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:58:15.533 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:59:04.606 [info] <0.8.0> Log file opened with Lager 2025-05-01 00:59:07.634 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 00:59:07.634 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 00:59:07.683 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 00:59:07.757 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61147_755245") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 00:59:17.757 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 00:59:17.757 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4076506081.2239365121.169870>} ** Reason for termination == ** killed 2025-05-01 00:59:17.757 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:59:17.757 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 00:59:17.757 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 00:59:17.757 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:59:17.758 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 00:59:17.758 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 00:59:17.758 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 00:59:17.758 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:00:08.726 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:00:11.425 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:00:11.425 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:00:11.459 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:00:11.542 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61211_540053") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:00:21.541 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:00:21.542 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4224832277.2239627265.131364>} ** Reason for termination == ** killed 2025-05-01 01:00:21.542 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:00:21.542 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:00:21.542 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:00:21.542 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:00:21.542 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:00:21.542 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:00:21.542 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:00:21.542 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:01:14.714 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:01:17.404 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:01:17.404 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:01:17.441 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:01:17.521 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61277_518818") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:01:27.520 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:01:27.520 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2982357162.2777022465.232036>} ** Reason for termination == ** killed 2025-05-01 01:01:27.520 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:01:27.520 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:01:27.521 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:01:27.521 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:01:27.521 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:01:27.522 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:01:27.522 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:01:27.522 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:02:18.884 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:02:21.338 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:02:21.338 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:02:21.371 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:02:21.449 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61341_448852") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:02:31.449 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:02:31.450 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3026800736.2777546753.96095>} ** Reason for termination == ** killed 2025-05-01 01:02:31.450 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:02:31.450 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:02:31.450 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:02:31.450 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:02:31.450 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:02:31.450 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:02:31.451 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:02:31.451 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:03:23.038 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:03:25.740 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:03:25.740 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:03:25.780 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:03:25.837 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61405_835477") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:03:35.836 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:03:35.837 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3231978290.2777546753.135035>} ** Reason for termination == ** killed 2025-05-01 01:03:35.837 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:03:35.837 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:03:35.837 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:03:35.837 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:03:35.837 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:03:35.837 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:03:35.838 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:03:35.838 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:04:21.809 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:04:24.369 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:04:24.369 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:04:24.399 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:04:24.453 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61464_452561") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:04:34.454 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:04:34.454 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2781159791.1435369473.216818>} ** Reason for termination == ** killed 2025-05-01 01:04:34.454 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:04:34.454 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:04:34.454 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:04:34.455 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:04:34.455 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:04:34.455 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:04:34.455 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:04:34.455 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:05:19.059 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:05:21.539 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:05:21.539 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:05:21.573 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:05:21.632 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61521_631169") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:05:31.632 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:05:31.633 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3942514631.3851550721.237792>} ** Reason for termination == ** killed 2025-05-01 01:05:31.633 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:05:31.633 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:05:31.633 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:05:31.633 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:05:31.633 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:05:31.633 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:05:31.633 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:05:31.633 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:06:24.342 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:06:27.010 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:06:27.011 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:06:27.059 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:06:27.130 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61587_129570") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:06:37.131 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:06:37.131 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2272755422.93192193.232957>} ** Reason for termination == ** killed 2025-05-01 01:06:37.131 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:06:37.131 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:06:37.131 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:06:37.131 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:06:37.133 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:06:37.133 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:06:37.134 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:06:37.134 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:07:30.337 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:07:33.186 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:07:33.186 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:07:33.220 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:07:33.289 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61653_287057") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:07:43.288 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:07:43.289 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1613122509.630325249.197114>} ** Reason for termination == ** killed 2025-05-01 01:07:43.289 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:07:43.289 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:07:43.289 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:07:43.289 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:07:43.290 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:07:43.289 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:07:43.290 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:07:43.290 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:08:32.661 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:08:35.153 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:08:35.153 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:08:35.192 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:08:35.251 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61715_248425") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:08:45.249 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:08:45.249 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1444971560.93454337.189406>} ** Reason for termination == ** killed 2025-05-01 01:08:45.249 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:08:45.250 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:08:45.250 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:08:45.251 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:08:45.251 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:08:45.251 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:08:45.251 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:08:45.251 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:09:32.540 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:09:35.338 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:09:35.338 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:09:35.377 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:09:35.445 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61775_437687") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:09:45.438 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:09:45.439 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2135368482.3314941953.244156>} ** Reason for termination == ** killed 2025-05-01 01:09:45.439 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:09:45.439 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:09:45.439 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:09:45.439 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:09:45.440 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:09:45.440 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:09:45.440 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:09:45.440 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:10:38.307 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:10:40.814 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:10:40.814 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:10:40.843 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:10:40.902 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61840_900545") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:10:50.902 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:10:50.902 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1931274852.3851812865.128545>} ** Reason for termination == ** killed 2025-05-01 01:10:50.903 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:10:50.903 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:10:50.903 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:10:50.903 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:10:50.903 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:10:50.903 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:10:50.903 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:10:50.904 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:11:36.605 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:11:38.964 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:11:38.964 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:11:38.992 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:11:39.072 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61899_69837") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:11:49.071 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:11:49.071 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.861328167.2241724417.67328>} ** Reason for termination == ** killed 2025-05-01 01:11:49.071 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:11:49.072 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:11:49.072 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:11:49.072 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:11:49.072 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:11:49.072 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:11:49.072 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:11:49.072 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:12:39.264 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:12:41.641 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:12:41.641 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:12:41.678 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:12:41.742 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_61961_741221") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:12:51.742 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:12:51.743 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3798957157.1705377793.217567>} ** Reason for termination == ** killed 2025-05-01 01:12:51.743 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:12:51.743 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:12:51.743 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:12:51.743 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:12:51.743 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:12:51.744 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:12:51.744 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:12:51.744 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:13:40.668 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:13:43.311 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:13:43.311 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:13:43.340 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:13:43.410 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62023_407364") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:13:53.409 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:13:53.409 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3159171072.1168506881.25512>} ** Reason for termination == ** killed 2025-05-01 01:13:53.409 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:13:53.409 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:13:53.410 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:13:53.410 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:13:53.410 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:13:53.411 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:13:53.411 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:13:53.411 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:14:43.993 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:14:48.590 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:14:48.591 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:14:48.641 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:14:48.772 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62088_770367") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:14:58.771 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:14:58.771 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4011271780.900333569.254749>} ** Reason for termination == ** killed 2025-05-01 01:14:58.771 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:14:58.771 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:14:58.775 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:14:58.775 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:14:58.775 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:14:58.775 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:14:58.775 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:14:58.775 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:15:44.382 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:15:49.135 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:15:49.135 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:15:49.211 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:15:49.320 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62149_319182") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:15:59.320 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:15:59.320 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3840113275.94765057.89345>} ** Reason for termination == ** killed 2025-05-01 01:15:59.320 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:15:59.320 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:15:59.321 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:15:59.321 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:15:59.321 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:15:59.321 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:15:59.321 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:15:59.321 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:16:52.341 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:16:54.946 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:16:54.946 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:16:54.979 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:16:55.036 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62215_33878") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:17:05.035 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:17:05.035 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1863830871.1168769025.69163>} ** Reason for termination == ** killed 2025-05-01 01:17:05.036 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:17:05.036 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:17:05.036 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:17:05.036 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:17:05.036 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:17:05.036 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:17:05.036 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:17:05.036 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:18:00.368 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:18:04.658 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:18:04.658 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:18:04.689 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:18:04.748 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62284_746891") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:18:14.748 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:18:14.749 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2087434616.1974861825.62399>} ** Reason for termination == ** killed 2025-05-01 01:18:14.749 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:18:14.749 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:18:14.749 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:18:14.749 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:18:14.750 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:18:14.750 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:18:14.750 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:18:14.750 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:19:00.488 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:19:05.105 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:19:05.105 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:19:05.150 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:19:05.214 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62345_212686") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:19:15.214 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:19:15.215 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1793598637.1168769025.165958>} ** Reason for termination == ** killed 2025-05-01 01:19:15.215 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:19:15.215 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:19:15.216 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:19:15.216 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:19:15.216 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:19:15.216 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:19:15.216 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:19:15.216 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:20:06.653 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:20:09.478 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:20:09.478 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:20:09.519 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:20:09.579 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62409_578205") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:20:19.580 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:20:19.580 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.420743070.1705902081.62484>} ** Reason for termination == ** killed 2025-05-01 01:20:19.581 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:20:19.582 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:20:19.582 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:20:19.582 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:20:19.582 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:20:19.582 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:20:19.582 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:20:19.583 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:21:08.205 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:21:10.819 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:21:10.819 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:21:10.849 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:21:10.900 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62470_898026") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:21:20.899 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:21:20.899 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1028592007.1169031169.144841>} ** Reason for termination == ** killed 2025-05-01 01:21:20.899 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:21:20.899 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:21:20.899 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:21:20.899 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:21:20.900 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:21:20.900 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:21:20.900 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:21:20.900 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:22:13.318 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:22:15.798 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:22:15.798 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:22:15.829 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:22:15.887 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62535_886621") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:22:25.888 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:22:25.889 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2322085143.1437728769.135765>} ** Reason for termination == ** killed 2025-05-01 01:22:25.889 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:22:25.889 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:22:25.889 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:22:25.889 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:22:25.889 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:22:25.889 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:22:25.890 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:22:25.890 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:23:16.807 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:23:19.621 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:23:19.621 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:23:19.662 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:23:19.724 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62599_723820") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:23:29.725 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:23:29.726 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2889633183.1170079745.146793>} ** Reason for termination == ** killed 2025-05-01 01:23:29.726 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:23:29.726 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:23:29.726 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:23:29.726 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:23:29.726 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:23:29.726 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:23:29.727 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:23:29.729 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:24:17.832 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:24:20.889 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:24:20.889 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:24:20.922 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:24:20.979 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62660_977970") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:24:30.979 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:24:30.979 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2012777011.364511233.228824>} ** Reason for termination == ** killed 2025-05-01 01:24:30.979 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:24:30.979 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:24:30.980 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:24:30.980 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:24:30.980 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:24:30.980 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:24:30.980 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:24:30.980 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:25:26.325 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:25:29.300 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:25:29.300 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:25:29.363 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:25:29.428 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62729_427662") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:25:39.429 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:25:39.430 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4152937622.1706950657.36649>} ** Reason for termination == ** killed 2025-05-01 01:25:39.430 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:25:39.430 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:25:39.430 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:25:39.430 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:25:39.431 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:25:39.431 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:25:39.431 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:25:39.431 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:26:20.917 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:26:23.842 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:26:23.843 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:26:23.881 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:26:23.927 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62783_925955") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:26:33.927 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:26:33.928 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.676887940.3318349825.18023>} ** Reason for termination == ** killed 2025-05-01 01:26:33.928 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:26:33.928 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:26:33.928 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:26:33.928 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:26:33.929 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:26:33.929 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:26:33.929 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:26:33.930 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:27:25.703 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:27:28.032 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:27:28.032 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:27:28.079 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:27:28.146 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62848_145129") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:27:38.146 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:27:38.146 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1480955639.3586260993.88256>} ** Reason for termination == ** killed 2025-05-01 01:27:38.146 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:27:38.147 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:27:38.147 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:27:38.147 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:27:38.147 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:27:38.148 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:27:38.148 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:27:38.148 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:28:17.218 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:28:19.497 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:28:19.497 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:28:19.531 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:28:19.584 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62899_582508") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:28:29.583 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:28:29.584 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1409388226.365035521.88952>} ** Reason for termination == ** killed 2025-05-01 01:28:29.584 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:28:29.584 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:28:29.585 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:28:29.585 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:28:29.585 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:28:29.585 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:28:29.585 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:28:29.585 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:29:19.608 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:29:22.315 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:29:22.315 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:29:22.346 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:29:22.403 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_62962_400571") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:29:32.401 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:29:32.402 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2289725345.4123131905.175735>} ** Reason for termination == ** killed 2025-05-01 01:29:32.402 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:29:32.402 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:29:32.403 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:29:32.403 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:29:32.403 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:29:32.403 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:29:32.403 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:29:32.404 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:30:16.145 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:30:18.759 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:30:18.760 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:30:18.790 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:30:18.857 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63018_856049") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:30:28.858 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:30:28.858 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.847502618.1976696833.63173>} ** Reason for termination == ** killed 2025-05-01 01:30:28.858 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:30:28.858 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:30:28.858 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:30:28.858 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:30:28.859 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:30:28.859 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:30:28.859 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:30:28.859 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:31:19.265 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:31:21.694 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:31:21.694 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:31:21.726 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:31:21.799 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63081_798027") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:31:31.799 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:31:31.799 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.715472341.1708261377.72674>} ** Reason for termination == ** killed 2025-05-01 01:31:31.799 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:31:31.799 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:31:31.800 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:31:31.800 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:31:31.800 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:31:31.800 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:31:31.801 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:31:31.801 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:32:19.857 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:32:22.426 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:32:22.426 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:32:22.460 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:32:22.522 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63142_519458") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:32:32.520 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:32:32.521 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2843539818.903217153.62521>} ** Reason for termination == ** killed 2025-05-01 01:32:32.521 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:32:32.521 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:32:32.521 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:32:32.522 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:32:32.522 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:32:32.522 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:32:32.522 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:32:32.522 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:33:27.194 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:33:30.046 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:33:30.046 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:33:30.075 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:33:30.140 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63210_139299") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:33:40.141 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:33:40.142 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2614239399.1708523521.252724>} ** Reason for termination == ** killed 2025-05-01 01:33:40.142 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:33:40.142 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:33:40.142 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:33:40.142 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:33:40.142 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:33:40.142 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:33:40.142 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:33:40.143 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:34:29.910 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:34:32.703 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:34:32.703 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:34:32.737 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:34:32.795 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63272_794283") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:34:42.795 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:34:42.795 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.787631041.1440350209.67721>} ** Reason for termination == ** killed 2025-05-01 01:34:42.795 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:34:42.795 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:34:42.796 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:34:42.796 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:34:42.796 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:34:42.796 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:34:42.796 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:34:42.796 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:35:32.037 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:35:34.649 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:35:34.649 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:35:34.696 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:35:34.766 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63334_765076") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:35:44.767 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:35:44.767 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.659307605.903479297.178076>} ** Reason for termination == ** killed 2025-05-01 01:35:44.767 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:35:44.767 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:35:44.767 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:35:44.768 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:35:44.768 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:35:44.768 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:35:44.768 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:35:44.768 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:36:30.511 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:36:33.314 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:36:33.314 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:36:33.361 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:36:33.436 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63393_435090") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:36:43.436 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:36:43.437 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3272997857.3856007169.47534>} ** Reason for termination == ** killed 2025-05-01 01:36:43.437 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:36:43.437 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:36:43.437 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:36:43.437 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:36:43.437 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:36:43.437 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:36:43.437 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:36:43.438 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:37:36.913 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:37:39.455 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:37:39.455 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:37:39.488 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:37:39.547 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63459_546203") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:37:49.548 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:37:49.548 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3223258211.98435073.193436>} ** Reason for termination == ** killed 2025-05-01 01:37:49.548 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:37:49.549 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:37:49.549 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:37:49.549 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:37:49.549 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:37:49.549 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:37:49.550 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:37:49.550 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:38:41.971 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:38:44.327 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:38:44.327 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:38:44.359 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:38:44.406 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63524_405899") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:38:54.407 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:38:54.407 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4008998830.367394817.38119>} ** Reason for termination == ** killed 2025-05-01 01:38:54.407 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:38:54.407 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:38:54.407 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:38:54.408 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:38:54.408 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:38:54.408 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:38:54.408 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:38:54.408 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:39:40.794 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:39:43.552 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:39:43.552 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:39:43.584 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:39:43.643 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63583_642100") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:39:53.643 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:39:53.643 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.4022347777.3320184833.194533>} ** Reason for termination == ** killed 2025-05-01 01:39:53.643 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:39:53.644 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:39:53.644 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:39:53.644 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:39:53.644 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:39:53.644 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:39:53.645 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:39:53.645 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:40:39.691 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:40:42.142 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:40:42.142 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:40:42.173 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:40:42.233 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63642_232060") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:40:52.234 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:40:52.234 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.979154404.1977745409.159521>} ** Reason for termination == ** killed 2025-05-01 01:40:52.235 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:40:52.235 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:40:52.235 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:40:52.235 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:40:52.235 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:40:52.236 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:40:52.236 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:40:52.237 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:41:38.565 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:41:41.076 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:41:41.076 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:41:41.116 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:41:41.165 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63701_164177") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:41:51.165 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:41:51.165 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.3936604864.636092417.99776>} ** Reason for termination == ** killed 2025-05-01 01:41:51.166 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:41:51.166 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:41:51.166 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:41:51.166 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:41:51.166 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:41:51.166 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:41:51.166 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:41:51.167 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:42:39.225 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:42:41.825 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:42:41.825 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:42:41.863 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:42:41.923 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63761_922225") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:42:51.924 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:42:51.925 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.2599113385.3857580033.99798>} ** Reason for termination == ** killed 2025-05-01 01:42:51.925 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:42:51.925 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:42:51.925 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:42:51.926 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:42:51.926 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:42:51.927 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:42:51.927 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:42:51.928 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:43:42.080 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:43:45.436 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:43:45.436 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:43:45.504 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:43:45.609 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63825_608002") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:43:55.609 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:43:55.609 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.953013052.3589406721.89735>} ** Reason for termination == ** killed 2025-05-01 01:43:55.609 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:43:55.609 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:43:55.609 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:43:55.610 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:43:55.610 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:43:55.610 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:43:55.610 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:43:55.610 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:44:40.894 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:44:43.824 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:44:43.824 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:44:43.856 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:44:43.908 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63883_907808") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}} 2025-05-01 01:44:53.909 [error] <0.164.0> Supervisor mnesia_sup had child mnesia_kernel_sup started with mnesia_kernel_sup:start() at undefined exit with reason killed in context start_error 2025-05-01 01:44:53.910 [error] <0.169.0> ** Generic server mnesia_subscr terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,#Ref<0.1727687155.2247229441.22226>} ** Reason for termination == ** killed 2025-05-01 01:44:53.910 [error] <0.169.0> CRASH REPORT Process mnesia_subscr with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:44:53.910 [error] <0.168.0> ** Generic server mnesia_monitor terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,[],[],true,[],undefined,[],[]} ** Reason for termination == ** killed 2025-05-01 01:44:53.910 [error] <0.171.0> ** Generic server mnesia_recover terminating ** Last message in was {'EXIT',<0.167.0>,killed} ** When Server state == {state,<0.167.0>,undefined,undefined,undefined,0,false,true,[]} ** Reason for termination == ** killed 2025-05-01 01:44:53.910 [error] <0.171.0> CRASH REPORT Process mnesia_recover with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:44:53.910 [error] <0.162.0> CRASH REPORT Process <0.162.0> with 0 neighbours exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} in application_master:init/4 line 138 2025-05-01 01:44:53.910 [error] <0.168.0> CRASH REPORT Process mnesia_monitor with 0 neighbours exited with reason: killed in gen_server:decode_msg/9 line 432 2025-05-01 01:44:53.911 [info] <0.43.0> Application mnesia exited with reason: {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}},{mnesia_app,start,[normal,[]]}} 2025-05-01 01:44:53.911 [error] <0.8.0> Error description: init:do_boot/3 init:start_em/1 rabbit:start_it/1 line 502 rabbit:broker_start/1 line 378 rabbit:start_loaded_apps/2 line 603 app_utils:manage_applications/6 line 126 lists:foldl/3 line 1263 rabbit:'-handle_app_error/1-fun-0-'/3 line 724 throw:{could_not_start,mnesia, {mnesia, {{shutdown,{failed_to_start_child,mnesia_kernel_sup,killed}}, {mnesia_app,start,[normal,[]]}}}} Log file(s) (may contain more information): /var/log/contrail/config-database-rabbitmq/rabbitmq.log /var/log/rabbitmq/contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_upgrade.log 2025-05-01 01:45:34.908 [info] <0.8.0> Log file opened with Lager 2025-05-01 01:45:39.409 [info] <0.8.0> Feature flags: list of feature flags found: 2025-05-01 01:45:39.410 [info] <0.8.0> Feature flags: feature flag states written to disk: yes 2025-05-01 01:45:39.489 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** mnesia_event got {inconsistent_database, starting_partitioned_network, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'} 2025-05-01 01:45:39.583 [error] <0.165.0> Mnesia('contrail@cn-jenkins-deploy-platform-ansible-os-3251-3'): ** ERROR ** (core dumped to file: "/var/lib/rabbitmq/MnesiaCore.contrail@cn-jenkins-deploy-platform-ansible-os-3251-3_1746_63939_579588") ** FATAL ** Failed to merge schema: Bad cookie in table definition 'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2': 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-3' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060185889883061,-576460752303420415,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}, 'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2' = {cstruct,'tracked_connection_per_vhost_on_node_contrail@cn-jenkins-deploy-platform-ansible-os-3251-2',set,['contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'],[],[],[],0,read_write,false,[],[],false,tracked_connection_per_vhost,[vhost,connection_count],[],[],[],{{1746060202780295327,-576460752303422910,1},'contrail@cn-jenkins-deploy-platform-ansible-os-3251-2'},{{2,0},[]}}