aweber / rabbitmq-autocluster

This project is now maintained by the RabbitMQ Team, visit the official repo @
https://github.com/rabbitmq/rabbitmq-autocluster
BSD 3-Clause "New" or "Revised" License
337 stars 120 forks source link

Error starting up #95

Closed eriiccc closed 6 years ago

eriiccc commented 7 years ago

I'm running into an error starting up rabbit with the plugin enabled to cluster autoscale group members. The machines have the correct IAM roles and I currently have 2 machines running in the asg.

Neither machine will successfully start rabbitmq-server with the autocluster stanza active in the config file. If I comment the stanza out, the machines each successfully can start rabbitmq-server.

Here's the error report:

=CRASH REPORT==== 21-Sep-2016::21:26:25 ===
  crasher:
    initial call: application_master:init/4
    pid: <0.154.0>
    registered_name: []
    exception exit: {bad_return,
                        {{rabbit,start,[normal,[]]},
                         {'EXIT',
                             {function_clause,
                                 [{autocluster,maybe_register,
                                      [error,aws,autocluster_aws],
                                      [{file,"src/autocluster.erl"},
                                       {line,111}]},
                                  {autocluster,init,0,
                                      [{file,"src/autocluster.erl"},
                                       {line,33}]},
                                  {rabbit_boot_steps,
                                      '-run_step/2-lc$^1/1-1-',1,
                                      [{file,"src/rabbit_boot_steps.erl"},
                                       {line,49}]},
                                  {rabbit_boot_steps,run_step,2,
                                      [{file,"src/rabbit_boot_steps.erl"},
                                       {line,49}]},
                                  {rabbit_boot_steps,
                                      '-run_boot_steps/1-lc$^0/1-0-',1,
                                      [{file,"src/rabbit_boot_steps.erl"},
                                       {line,26}]},
                                  {rabbit_boot_steps,run_boot_steps,1,
                                      [{file,"src/rabbit_boot_steps.erl"},
                                       {line,26}]},
                                  {rabbit,start,2,
                                      [{file,"src/rabbit.erl"},{line,583}]},
                                  {application_master,start_it_old,4,
                                      [{file,"application_master.erl"},
                                       {line,273}]}]}}}}
      in function  application_master:init/4 (application_master.erl, line 134)
    ancestors: [<0.153.0>]
    messages: [{'EXIT',<0.155.0>,normal}]
    links: [<0.153.0>,<0.7.0>]
    dictionary: []
    trap_exit: true
    status: running
    heap_size: 2586
    stack_size: 27
    reductions: 255
  neighbours:

My rabbit.config file

[
 {rabbit,
  [
   {log_levels, [{autocluster, debug}, {connection, debug}, {mirroring, debug}, {channel, debug}]},
   {tcp_listeners, [5672]},
   {disk_free_limit, 2147483648},
   {heartbeat, 0},
   {tcp_listen_options, [binary, {backlog, 1024}, {nodelay, true}, {keepalive, true} ]},
   {vm_memory_high_watermark, 0.6},
   {default_user, <<"guest">>},
   {default_pass, <<"guest">>},
   {loopback_users, []}
  ]},
 {kernel,
  ]},
 {autocluster,
  [
   {backend, aws},
   {aws_autoscaling, true},
   {autocluster_failure, ignore},
   {startup_delay, 7},
   {node_type, 'disc'}
  ]},
 {rabbitmq_management,
  ]},
 {rabbitmq_shovel,
  [{shovels,
    ]}
  ]},
 {rabbitmq_stomp,
  ]},
 {rabbitmq_mqtt,
  ]},
 {rabbitmq_amqp1_0,
  ]},
 {rabbitmq_auth_backend_ldap,
  ]}
].

My enabled.plugins file

[autocluster,rabbitmq_federation,rabbitmq_federation_management,rabbitmq_management,rabbitmq_management_agent,rabbitmq_management_visualiser,rabbitmq_mqtt,rabbitmq_stomp,sockjs].

Specs:

michaelklishin commented 7 years ago

I'd close this in favour of #104 which has a few investigation comments based on the stack traces and the AWS backend code.

gmr commented 6 years ago

This plugin was forked by the RabbitMQ team and is now part of RabbitMQ. More information can be found @ https://github.com/rabbitmq/rabbitmq-autocluster