[bitnami/rabbitmq] unable to start rabbitmq docker container after 3.13

chengjie8 commented 3 weeks ago

Name and Version

bitnami/rabbitmq:3.13

What architecture are you using?

None

What steps will reproduce the bug?

docker pull bitnami/rabbitmq:3.13
docker run -d --name rabbitmq-server-2 -p 15672:15672 -p 5672:5672 \ -e RABBITMQ_LOGS=- \ -e RABBITMQ_LOG_LEVEL=debug \ bitnami/rabbitmq:3.13

What is the expected behavior?

rabbitmq container starts and no issue

What do you see instead?

2024-08-27 12:39:20 rabbitmq 16:39:20.39 INFO  ==> Welcome to the Bitnami rabbitmq container
2024-08-27 12:39:20 rabbitmq 16:39:20.41 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
2024-08-27 12:39:20 rabbitmq 16:39:20.43 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
2024-08-27 12:39:20 rabbitmq 16:39:20.46 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
2024-08-27 12:39:20 rabbitmq 16:39:20.48 INFO  ==> 
2024-08-27 12:39:20 rabbitmq 16:39:20.54 INFO  ==> ** Starting RabbitMQ setup **
2024-08-27 12:39:20 rabbitmq 16:39:20.66 INFO  ==> Validating settings in RABBITMQ_* env vars..
2024-08-27 12:39:20 rabbitmq 16:39:20.86 INFO  ==> Initializing RabbitMQ...
2024-08-27 12:39:21 rabbitmq 16:39:21.03 INFO  ==> Generating random cookie
2024-08-27 12:39:21 rabbitmq 16:39:21.22 INFO  ==> Starting RabbitMQ in background...
2024-08-27 12:41:42 rabbitmq 16:41:42.70 ERROR ==> Couldn't start RabbitMQ in background.

then the container shuts down

Additional information

I had no issues starting 3.12 containers with the same Docker command. Now, I am encountering the same behavior and issues with all 3.13 images (e.g., 3.13, 3.13.6, and 3.13-debian-12).
I use an M1 Mac, if that matters.

javsalgar commented 2 weeks ago

Hi!

Could you launch the container with BITNAMI_DEBUG=true?

chengjie8 commented 2 weeks ago

@javsalgar I have added that. The container starts now but with boot failure message, do you know how to resolve the issue?

2024-08-29 10:24:28 rabbitmq 14:24:28.46 INFO  ==> 
2024-08-29 10:24:28 rabbitmq 14:24:28.50 INFO  ==> Welcome to the Bitnami rabbitmq container
2024-08-29 10:24:28 rabbitmq 14:24:28.53 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
2024-08-29 10:24:28 rabbitmq 14:24:28.55 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
2024-08-29 10:24:28 rabbitmq 14:24:28.58 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
2024-08-29 10:24:28 rabbitmq 14:24:28.61 INFO  ==> 
2024-08-29 10:24:28 rabbitmq 14:24:28.68 INFO  ==> ** Starting RabbitMQ setup **
2024-08-29 10:24:28 rabbitmq 14:24:28.84 INFO  ==> Validating settings in RABBITMQ_* env vars..
2024-08-29 10:24:29 rabbitmq 14:24:29.09 INFO  ==> Initializing RabbitMQ...
2024-08-29 10:24:29 rabbitmq 14:24:29.14 DEBUG ==> Creating configuration file...
2024-08-29 10:24:29 rabbitmq 14:24:29.24 DEBUG ==> Creating environment file...
2024-08-29 10:24:29 rabbitmq 14:24:29.28 DEBUG ==> Creating enabled_plugins file...
2024-08-29 10:24:29 rabbitmq 14:24:29.38 DEBUG ==> Creating Erlang cookie...
2024-08-29 10:24:29 rabbitmq 14:24:29.41 INFO  ==> Generating random cookie
2024-08-29 10:24:29 rabbitmq 14:24:29.51 DEBUG ==> Ensuring expected directories/files exist...
2024-08-29 10:24:29 rabbitmq 14:24:29.67 INFO  ==> Starting RabbitMQ in background...
2024-08-29 10:24:34 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:24:36 Waiting for applications 'rabbit_and_plugins' to start on node 'rabbit@localhost'
2024-08-29 10:24:41 2024-08-29 14:24:41.093871+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-08-29 10:24:41 2024-08-29 14:24:41.117063+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-08-29 10:24:41 2024-08-29 14:24:41.123405+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-08-29 10:24:41 2024-08-29 14:24:41.151214+00:00 [info] <0.254.0> ra: starting system quorum_queues
2024-08-29 10:24:41 2024-08-29 14:24:41.151898+00:00 [info] <0.254.0> starting Ra system: quorum_queues in directory: /bitnami/rabbitmq/mnesia/rabbit@localhost/quorum/rabbit@localhost
2024-08-29 10:24:41 2024-08-29 14:24:41.360285+00:00 [info] <0.315.0> ra system 'quorum_queues' running pre init for 0 registered servers
2024-08-29 10:24:41 2024-08-29 14:24:41.390839+00:00 [info] <0.316.0> ra: meta data store initialised for system quorum_queues. 0 record(s) recovered
2024-08-29 10:24:41 2024-08-29 14:24:41.434190+00:00 [notice] <0.321.0> WAL: ra_log_wal init, open tbls: ra_log_open_mem_tables, closed tbls: ra_log_closed_mem_tables
2024-08-29 10:24:41 2024-08-29 14:24:41.474609+00:00 [info] <0.254.0> ra: starting system coordination
2024-08-29 10:24:41 2024-08-29 14:24:41.475035+00:00 [info] <0.254.0> starting Ra system: coordination in directory: /bitnami/rabbitmq/mnesia/rabbit@localhost/coordination/rabbit@localhost
2024-08-29 10:24:41 2024-08-29 14:24:41.479449+00:00 [info] <0.330.0> ra system 'coordination' running pre init for 0 registered servers
2024-08-29 10:24:41 2024-08-29 14:24:41.482188+00:00 [info] <0.331.0> ra: meta data store initialised for system coordination. 0 record(s) recovered
2024-08-29 10:24:41 2024-08-29 14:24:41.483192+00:00 [notice] <0.336.0> WAL: ra_coordination_log_wal init, open tbls: ra_coordination_log_open_mem_tables, closed tbls: ra_coordination_log_closed_mem_tables
2024-08-29 10:24:41 2024-08-29 14:24:41.487308+00:00 [info] <0.254.0> ra: starting system coordination
2024-08-29 10:24:41 2024-08-29 14:24:41.487534+00:00 [info] <0.254.0> starting Ra system: coordination in directory: /bitnami/rabbitmq/mnesia/rabbit@localhost/coordination/rabbit@localhost
2024-08-29 10:24:41 2024-08-29 14:24:41.794223+00:00 [info] <0.254.0> Waiting for Khepri leader for 30000 ms, 9 retries left
2024-08-29 10:24:41 2024-08-29 14:24:41.809354+00:00 [notice] <0.341.0> RabbitMQ metadata store: candidate -> leader in term: 1 machine version: 1
2024-08-29 10:24:41 2024-08-29 14:24:41.857264+00:00 [info] <0.254.0> Khepri leader elected
2024-08-29 10:24:41 2024-08-29 14:24:41.857844+00:00 [info] <0.254.0> Waiting for Khepri projections for 30000 ms, 9 retries left
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0> 
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0>  Starting RabbitMQ 3.13.7 on Erlang 26.2.5 [jit]
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0>  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
2024-08-29 10:24:42 2024-08-29 14:24:42.827287+00:00 [info] <0.254.0>  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2024-08-29 10:24:42 
2024-08-29 10:24:42   ##  ##      RabbitMQ 3.13.7
2024-08-29 10:24:42   ##  ##
2024-08-29 10:24:42   ##########  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
2024-08-29 10:24:42   ######  ##
2024-08-29 10:24:42   ##########  Licensed under the MPL 2.0. Website: https://rabbitmq.com
2024-08-29 10:24:42 
2024-08-29 10:24:42   Erlang:      26.2.5 [jit]
2024-08-29 10:24:42   TLS Library: OpenSSL - OpenSSL 3.0.13 30 Jan 2024
2024-08-29 10:24:42   Release series support status: see https://www.rabbitmq.com/release-information
2024-08-29 10:24:42 
2024-08-29 10:24:42   Doc guides:  https://www.rabbitmq.com/docs
2024-08-29 10:24:42   Support:     https://www.rabbitmq.com/docs/contact
2024-08-29 10:24:42   Tutorials:   https://www.rabbitmq.com/tutorials
2024-08-29 10:24:42   Monitoring:  https://www.rabbitmq.com/docs/monitoring
2024-08-29 10:24:42   Upgrading:   https://www.rabbitmq.com/docs/upgrade
2024-08-29 10:24:42 
2024-08-29 10:24:42   Logs: <stdout>
2024-08-29 10:24:42 
2024-08-29 10:24:42   Config file(s): /opt/bitnami/rabbitmq/etc/rabbitmq/rabbitmq.conf
2024-08-29 10:24:42 
2024-08-29 10:24:42   Starting broker...2024-08-29 14:24:42.834578+00:00 [info] <0.254.0> 
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  node           : rabbit@localhost
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  home dir       : /opt/bitnami/rabbitmq/.rabbitmq
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  config file(s) : /opt/bitnami/rabbitmq/etc/rabbitmq/rabbitmq.conf
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  cookie hash    : gID1/5+ssog1IS01pytRbw==
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  log(s)         : <stdout>
2024-08-29 10:24:42 2024-08-29 14:24:42.834578+00:00 [info] <0.254.0>  data dir       : /bitnami/rabbitmq/mnesia/rabbit@localhost
2024-08-29 10:24:44 2024-08-29 14:24:44.015628+00:00 [info] <0.254.0> Running boot step pre_boot defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.016269+00:00 [info] <0.254.0> Running boot step rabbit_global_counters defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.018867+00:00 [info] <0.254.0> Running boot step rabbit_osiris_metrics defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.019897+00:00 [info] <0.254.0> Running boot step rabbit_core_metrics defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.021555+00:00 [info] <0.254.0> Running boot step rabbit_alarm defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.114110+00:00 [info] <0.402.0> Memory high watermark set to 6394 MiB (6705266688 bytes) of 15986 MiB (16763166720 bytes) total
2024-08-29 10:24:44 2024-08-29 14:24:44.170735+00:00 [info] <0.404.0> Enabling free disk space monitoring (disk free space: 33641304064, total memory: 16763166720)
2024-08-29 10:24:44 2024-08-29 14:24:44.172739+00:00 [info] <0.404.0> Disk free limit set to 16763MB
2024-08-29 10:24:44 2024-08-29 14:24:44.208479+00:00 [info] <0.254.0> Running boot step code_server_cache defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.209153+00:00 [info] <0.254.0> Running boot step file_handle_cache defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.230396+00:00 [info] <0.408.0> Limiting to approx 1048479 file handles (943629 sockets)
2024-08-29 10:24:44 2024-08-29 14:24:44.232305+00:00 [info] <0.409.0> FHC read buffering: OFF
2024-08-29 10:24:44 2024-08-29 14:24:44.232601+00:00 [info] <0.409.0> FHC write buffering: ON
2024-08-29 10:24:44 2024-08-29 14:24:44.238829+00:00 [info] <0.254.0> Running boot step worker_pool defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.240032+00:00 [info] <0.376.0> Will use 5 processes for default worker pool
2024-08-29 10:24:44 2024-08-29 14:24:44.240453+00:00 [info] <0.376.0> Starting worker pool 'worker_pool' with 5 processes in it
2024-08-29 10:24:44 2024-08-29 14:24:44.245003+00:00 [info] <0.254.0> Running boot step database defined by app rabbit
2024-08-29 10:24:44 2024-08-29 14:24:44.248272+00:00 [info] <0.254.0> Peer discovery: configured backend: rabbit_peer_discovery_classic_config
2024-08-29 10:24:44 2024-08-29 14:24:44.252509+00:00 [notice] <0.377.0> Feature flags: attempt to enable `detailed_queues_endpoint`...
2024-08-29 10:24:44 2024-08-29 14:24:44.883266+00:00 [notice] <0.377.0> Feature flags: `detailed_queues_endpoint` enabled
2024-08-29 10:24:44 2024-08-29 14:24:44.884117+00:00 [notice] <0.377.0> Feature flags: attempt to enable `quorum_queue_non_voters`...
2024-08-29 10:24:45 2024-08-29 14:24:45.515363+00:00 [notice] <0.377.0> Feature flags: `quorum_queue_non_voters` enabled
2024-08-29 10:24:45 2024-08-29 14:24:45.516277+00:00 [notice] <0.377.0> Feature flags: attempt to enable `stream_update_config_command`...
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags: error while running:
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:   rabbit_feature_flags:mark_as_enabled_locally[stream_update_config_command,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0>                                                               state_changing]
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags: on node `rabbit@localhost`:
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:   exception error: {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                        {badmap,rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                        [{maps,filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                             [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                              rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                             [{file,"maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                              {line,611},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                              {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                         {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:                             [{file,"rabbit_feature_flags.erl"},{line,1202}]}]}
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:     in function  erpc:call/5 (erpc.erl, line 702)
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:     in call from rabbit_ff_controller:rpc_call/5 (rabbit_ff_controller.erl, line 1384)
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> Feature flags:     in call from rabbit_ff_controller:'-rpc_calls/5-fun-1-'/7 (rabbit_ff_controller.erl, line 1416)
2024-08-29 10:24:45 2024-08-29 14:24:45.540858+00:00 [error] <0.448.0> 
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags: error while running:
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:   rabbit_feature_flags:mark_as_enabled_locally[stream_update_config_command,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0>                                                               false]
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags: on node `rabbit@localhost`:
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:   exception error: {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                        {badmap,rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                        [{maps,filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                             [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                              rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                             [{file,"maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                              {line,611},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                              {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                         {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:                             [{file,"rabbit_feature_flags.erl"},{line,1202}]}]}
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:     in function  erpc:call/5 (erpc.erl, line 702)
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:     in call from rabbit_ff_controller:rpc_call/5 (rabbit_ff_controller.erl, line 1384)
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> Feature flags:     in call from rabbit_ff_controller:'-rpc_calls/5-fun-1-'/7 (rabbit_ff_controller.erl, line 1416)
2024-08-29 10:24:45 2024-08-29 14:24:45.543664+00:00 [error] <0.450.0> 
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0> Feature flags: failed to enable `stream_update_config_command`: {error,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                  {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                   {badmap,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                    rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                   [{maps,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     [{file,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       "maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      {line,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       611},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      {error_info,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       #{module =>
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                          erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                    {rabbit_feature_flags,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     mark_as_enabled_locally,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     2,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                     [{file,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       "rabbit_feature_flags.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                      {line,
2024-08-29 10:24:45 2024-08-29 14:24:45.545036+00:00 [error] <0.377.0>                                                                       1202}]}]}}
2024-08-29 10:24:45 2024-08-29 14:24:45.576223+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> 
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> BOOT FAILED
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> ===========
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> Error during startup: {error,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                        {incompatible_feature_flags,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                         {exception,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                          {badmap,rabbitmq_management},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                          [{maps,filter,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                            [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             rabbitmq_management],
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                            [{file,"maps.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             {line,611},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                           {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                            [{file,"rabbit_feature_flags.erl"},
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0>                             {line,1202}]}]}}}
2024-08-29 10:24:45 2024-08-29 14:24:45.577402+00:00 [error] <0.254.0> 
2024-08-29 10:24:45 
2024-08-29 10:24:45 BOOT FAILED
2024-08-29 10:24:45 ===========
2024-08-29 10:24:45 Error during startup: {error,
2024-08-29 10:24:45                        {incompatible_feature_flags,
2024-08-29 10:24:45                         {exception,
2024-08-29 10:24:45                          {badmap,rabbitmq_management},
2024-08-29 10:24:45                          [{maps,filter,
2024-08-29 10:24:45                            [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:45                             rabbitmq_management],
2024-08-29 10:24:45                            [{file,"maps.erl"},
2024-08-29 10:24:45                             {line,611},
2024-08-29 10:24:45                             {error_info,#{module => erl_stdlib_errors}}]},
2024-08-29 10:24:45                           {rabbit_feature_flags,mark_as_enabled_locally,2,
2024-08-29 10:24:45                            [{file,"rabbit_feature_flags.erl"},
2024-08-29 10:24:45                             {line,1202}]}]}}}
2024-08-29 10:24:45 
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>   crasher:
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     initial call: application_master:init/4
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     pid: <0.253.0>
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     registered_name: []
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     exception exit: {{incompatible_feature_flags,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                          {exception,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                              {badmap,rabbitmq_management},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                              [{maps,filter,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   [#Fun<rabbit_feature_flags.0.3681879>,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    rabbitmq_management],
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   [{file,"maps.erl"},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    {line,611},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    {error_info,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                        #{module => erl_stdlib_errors}}]},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                               {rabbit_feature_flags,mark_as_enabled_locally,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   2,
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                   [{file,"rabbit_feature_flags.erl"},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                                    {line,1202}]}]}},
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>                      {rabbit,start,[normal,[]]}}
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>       in function  application_master:init/4 (application_master.erl, line 142)
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     ancestors: [<0.252.0>]
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     message_queue_len: 1
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     messages: [{'EXIT',<0.254.0>,normal}]
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     links: [<0.252.0>,<0.44.0>]
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     dictionary: []
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     trap_exit: true
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     status: running
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     heap_size: 2586
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     stack_size: 28
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>     reductions: 212
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0>   neighbours:
2024-08-29 10:24:46 2024-08-29 14:24:46.596127+00:00 [error] <0.253.0> 
2024-08-29 10:24:46 2024-08-29 14:24:46.615220+00:00 [notice] <0.44.0> Application rabbit exited with reason: {{incompatible_feature_flags,{exception,{badmap,rabbitmq_management},[{maps,filter,[#Fun<rabbit_feature_flags.0.3681879>,rabbitmq_management],[{file,"maps.erl"},{line,611},{error_info,#{module => erl_stdlib_errors}}]},{rabbit_feature_flags,mark_as_enabled_locally,2,[{file,"rabbit_feature_flags.erl"},{line,1202}]}]}},{rabbit,start,[normal,[]]}}
2024-08-29 10:24:46 Stack trace: 
2024-08-29 10:24:46 
2024-08-29 10:24:46 ** (CaseClauseError) no case clause matching: {:badrpc, :nodedown}
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmq/cli/core/helpers.ex:105: anonymous fn/2 in RabbitMQ.CLI.Core.Helpers.stream_until_error_parameterised/2
2024-08-29 10:24:46     (elixir 1.17.2) lib/stream.ex:990: Stream.do_transform_user/6
2024-08-29 10:24:46     (elixir 1.17.2) lib/stream.ex:1891: Enumerable.Stream.do_each/4
2024-08-29 10:24:46     (elixir 1.17.2) lib/enum.ex:2585: Enum.reduce_while/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmq/cli/core/output.ex:56: RabbitMQ.CLI.Core.Output.print_output_0/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmq/cli/core/output.ex:31: RabbitMQ.CLI.Core.Output.print_output/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmqctl.ex:234: RabbitMQCtl.process_output/3
2024-08-29 10:24:46     (rabbitmqctl 3.13.0-dev) lib/rabbitmqctl.ex:642: RabbitMQCtl.maybe_with_distribution/3
2024-08-29 10:24:46 
2024-08-29 10:24:59 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:24:46 Runtime terminating during boot (terminating)
2024-08-29 10:24:46 
2024-08-29 10:24:46 Crash dump is being written to: /opt/bitnami/rabbitmq/var/log/rabbitmq/erl_crash.dump...{:case_clause, {:badrpc, :nodedown}}
2024-08-29 10:24:46 
2024-08-29 10:24:47 done
2024-08-29 10:24:47 [os_mon] cpu supervisor port (cpu_sup): Erlang has closed
2024-08-29 10:24:47 [os_mon] memory supervisor port (memsup): Erlang has closed
2024-08-29 10:25:00 Error:
2024-08-29 10:25:00 process_not_running
2024-08-29 10:25:13 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:13 Error:
2024-08-29 10:25:13 process_not_running
2024-08-29 10:25:26 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:26 Error:
2024-08-29 10:25:26 process_not_running
2024-08-29 10:25:39 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:39 Error:
2024-08-29 10:25:39 process_not_running
2024-08-29 10:25:53 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:25:53 Error:
2024-08-29 10:25:53 process_not_running
2024-08-29 10:26:06 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:06 Error:
2024-08-29 10:26:06 process_not_running
2024-08-29 10:26:19 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:19 Error:
2024-08-29 10:26:19 process_not_running
2024-08-29 10:26:32 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:33 Error:
2024-08-29 10:26:33 process_not_running
2024-08-29 10:26:46 Waiting for erlang distribution on node 'rabbit@localhost' while OS process '161' is running
2024-08-29 10:26:46 Error:
2024-08-29 10:26:46 process_not_running
2024-08-29 10:26:56 rabbitmq 14:26:56.45 ERROR ==> Couldn't start RabbitMQ in background.

jotamartos commented 2 weeks ago

Tried to reproduce the issue in a M1-based laptop and didn't run into that error. The issue is probably related to your environment.

➜  rabbitmq git:(main) docker run --rm -d --name rabbitmq-server-2 -p 15672:15672 -p 5672:5672 -e RABBITMQ_LOGS=- -e RABBITMQ_LOG_LEVEL=debug bitnami/rabbitmq:3.13
Unable to find image 'bitnami/rabbitmq:3.13' locally
3.13: Pulling from bitnami/rabbitmq
f23a9536491c: Pull complete 
Digest: sha256:de47a2cd1082534cbb2cac399f49f583844b72f94f5a498f3c3bd4383dd013af
Status: Downloaded newer image for bitnami/rabbitmq:3.13
76d6e501f2f016401ea7c5eadf8a1fd3193b243082561d91e87292e91e764c62
➜  rabbitmq git:(main) docker ps -a 
CONTAINER ID   IMAGE                                                                             COMMAND                  CREATED         STATUS         PORTS                                                                                                       NAMES
76d6e501f2f0   bitnami/rabbitmq:3.13                                                             "/opt/bitnami/script…"   3 seconds ago   Up 2 seconds   4369/tcp, 5551-5552/tcp, 5671/tcp, 0.0.0.0:5672->5672/tcp, 15671/tcp, 25672/tcp, 0.0.0.0:15672->15672/tcp   rabbitmq-server-2
➜  rabbitmq git:(main) docker logs -f rabbitmq-server-2
rabbitmq 11:40:01.04 INFO  ==> 
rabbitmq 11:40:01.04 INFO  ==> Welcome to the Bitnami rabbitmq container
rabbitmq 11:40:01.04 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
rabbitmq 11:40:01.04 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
rabbitmq 11:40:01.04 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
rabbitmq 11:40:01.04 INFO  ==> 
rabbitmq 11:40:01.04 INFO  ==> ** Starting RabbitMQ setup **
rabbitmq 11:40:01.05 INFO  ==> Validating settings in RABBITMQ_* env vars..
rabbitmq 11:40:01.06 INFO  ==> Initializing RabbitMQ...
rabbitmq 11:40:01.07 INFO  ==> Generating random cookie
rabbitmq 11:40:01.08 INFO  ==> Starting RabbitMQ in background...
rabbitmq 11:40:06.62 INFO  ==> No custom scripts in /docker-entrypoint-initdb.d
rabbitmq 11:40:06.63 INFO  ==> Stopping RabbitMQ...

rabbitmq 11:40:09.04 INFO  ==> ** RabbitMQ setup finished! **
rabbitmq 11:40:09.05 INFO  ==> ** Starting RabbitMQ **
2024-09-02 11:40:11.950177+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-09-02 11:40:11.954924+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-09-02 11:40:11.955339+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-09-02 11:40:11.961664+00:00 [info] <0.254.0> ra: starting system quorum_queues
...
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0> Server startup complete; 3 plugins started.
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0>  * rabbitmq_management
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0>  * rabbitmq_management_agent
2024-09-02 11:40:14.886750+00:00 [info] <0.541.0>  * rabbitmq_web_dispatch
2024-09-02 11:40:15.031214+00:00 [info] <0.9.0> Time to start RabbitMQ: 5817 ms

lyriccoder commented 1 week ago

I have the same issue, with 3.13 and 3.12. Any solution? It stucks at Couldn't start RabbitMQ in background. If I add your variable with DEBUG, i See the following:

rabbitmq-1  | rabbitmq 10:41:58.38 INFO  ==>
rabbitmq-1  | rabbitmq 10:41:58.38 INFO  ==> Welcome to the Bitnami rabbitmq container
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> Subscribe to project updates by watching https://github.com/bitnami/containers
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> Submit issues and feature requests at https://github.com/bitnami/containers/issues
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> Upgrade to Tanzu Application Catalog for production environments to access custom-configured and pre-packaged software components. Gain enhanced features, including Software Bill of Materials (SBOM), CVE scan result reports, and VEX documents. To learn more, visit https://bitnami.com/enterprise
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==>
rabbitmq-1  | rabbitmq 10:41:58.39 INFO  ==> ** Starting RabbitMQ setup **
rabbitmq-1  | rabbitmq 10:41:58.41 INFO  ==> Validating settings in RABBITMQ_* env vars..
rabbitmq-1  | rabbitmq 10:41:58.42 INFO  ==> Initializing RabbitMQ...
rabbitmq-1  | rabbitmq 10:41:58.43 DEBUG ==> Creating configuration file...
rabbitmq-1  | rabbitmq 10:41:58.43 DEBUG ==> Creating environment file...
rabbitmq-1  | rabbitmq 10:41:58.43 DEBUG ==> Creating enabled_plugins file...
rabbitmq-1  | rabbitmq 10:41:58.44 DEBUG ==> Creating Erlang cookie...
rabbitmq-1  | rabbitmq 10:41:58.44 INFO  ==> Generating random cookie
rabbitmq-1  | rabbitmq 10:41:58.45 DEBUG ==> Ensuring expected directories/files exist...
rabbitmq-1  | rabbitmq 10:41:58.46 INFO  ==> Starting RabbitMQ in background...
rabbitmq-1  | Waiting for erlang distribution on node 'rabbit@localhost' while OS process '60' is running
rabbitmq-1  | Error: operation wait on node rabbit@localhost timed out. Timeout value used: 5000
rabbitmq-1  | Waiting for erlang distribution on node 'rabbit@localhost' while OS process '60' is running
rabbitmq-1  | Error: operation wait on node rabbit@localhost timed out. Timeout value used: 5000

jotamartos commented 1 week ago

Hi!

Could you launch the container with BITNAMI_DEBUG=true?

Did you try enabling the debug mode? As I mentioned above, I couldn't reproduce the issue locally and our pipelines do not report this issue either.

lyriccoder commented 5 days ago

Hi! Could you launch the container with BITNAMI_DEBUG=true?

Did you try enabling the debug mode? As I mentioned above, I couldn't reproduce the issue locally and our pipelines do not report this issue either.

I added BITNAMI_DEBUG=true, so the log is above the current post. I can reproduce it on different machines with Ubuntu. I mean can't even find version of Ubuntu where it works. Strange, that issue is not reproducible. Seems it's related to nodename. Seems it uses different nodename inside

jotamartos commented 2 days ago

I mean can't even find version of Ubuntu where it works. Strange, that issue is not reproducible.

Just launched a fresh Ubuntu 24.04 machine

ubuntu@ip-172-31-15-51:~$ cat /etc/os-release
PRETTY_NAME="Ubuntu 24.04 LTS"
NAME="Ubuntu"
VERSION_ID="24.04"
VERSION="24.04 LTS (Noble Numbat)"
VERSION_CODENAME=noble
ID=ubuntu
ID_LIKE=debian
HOME_URL="https://www.ubuntu.com/"
SUPPORT_URL="https://help.ubuntu.com/"
BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/"
PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy"
UBUNTU_CODENAME=noble
LOGO=ubuntu-logo

and launched the docker run command again

$ docker run --rm --name rabbitmq-server-2 -p 15672:15672 -p 5672:5672 -e RABBITMQ_LOGS=- -e RABBITMQ_LOG_LEVEL=debug bitnami/rabbitmq:3.13
...
rabbitmq 10:56:20.73 INFO  ==> ** RabbitMQ setup finished! **

rabbitmq 10:56:20.75 INFO  ==> ** Starting RabbitMQ **
2024-09-16 10:56:25.455169+00:00 [notice] <0.44.0> Application syslog exited with reason: stopped
2024-09-16 10:56:25.461545+00:00 [notice] <0.254.0> Logging: switching to configured handler(s); following messages may not be visible in this log output
2024-09-16 10:56:25.464097+00:00 [notice] <0.254.0> Logging: configured log handlers are now ACTIVE
2024-09-16 10:56:25.491091+00:00 [info] <0.254.0> ra: starting system quorum_queues
...
  ##  ##      RabbitMQ 3.13.7
  ##  ##
  ##########  Copyright (c) 2007-2024 Broadcom Inc and/or its subsidiaries
  ######  ##
  ##########  Licensed under the MPL 2.0. Website: https://rabbitmq.com

  Erlang:      26.2.5 [jit]
  TLS Library: OpenSSL - OpenSSL 3.0.14 4 Jun 2024
...
2024-09-16 10:56:33.487698+00:00 [info] <0.533.0> Ready to start client connection listeners
2024-09-16 10:56:33.491210+00:00 [info] <0.653.0> started TCP listener on [::]:5672
 completed with 3 plugins.
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0> Server startup complete; 3 plugins started.
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0>  * rabbitmq_management
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0>  * rabbitmq_management_agent
2024-09-16 10:56:33.858551+00:00 [info] <0.533.0>  * rabbitmq_web_dispatch
2024-09-16 10:56:34.054130+00:00 [info] <0.9.0> Time to start RabbitMQ: 12885 ms
...

As you can see, the deployment succeeded. I'm using the latest docker version obtained from https://get.docker.com/

ubuntu@ip-172-31-15-51:~$ docker --version
Docker version 27.2.1, build 9e34c9b

bitnami / containers