search

osism / issues

This repository is used for bug reports that are cross-project or not bound to a specific repository (or to an unknown repository).
https://www.osism.tech
1 stars 1 forks source link

RabbitMQ in the OpenStack Yoga + Xena is broken #328

Closed berendt closed 2 years ago

berendt commented 2 years ago 
BOOT FAILED
===========
Exception during startup:

error:{badmatch,{error,{badrpc,{'EXIT',{noproc,{gen_server2,call,[worker_pool,{next_free,<13027.319.0>},infinity]}}}}}}

    rabbit:start/2, line 912
    application_master:start_it_old/4, line 293
osfrickler commented 2 years ago

Sample failing builds: https://zuul.osism.xyz/t/osism/build/c2665e796eab43388cf8b08a5c175517 (Xena) https://zuul.osism.xyz/t/osism/build/8d794b44d5334f8580b28d5af363fadc (Yoga)

osfrickler commented 2 years ago

Longer log with the failure from /var/log/kolla/rabbitmq/rabbit@testbed-node-1.log:

2022-09-27 08:44:08.282746+00:00 [notice] <0.1231.0> Feature flags: attempt to enable `listener_records_in_ets`...
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0> Feature flags: error while running:
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0> Feature flags:   rabbit_ff_controller:listener_records_in_ets_enable[#{command =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                         enable,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                        feature_name =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                         listener_records_in_ets,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                        feature_props =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                         #{callbacks =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                            #{enable =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                               {rabbit_core_ff,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                                listener_records_in_ets_enable},
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                              post_enable =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                               {rabbit_core_ff,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                                listener_records_in_ets_post_enable}},
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                           depends_on =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                            [feature_flags_v2],
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                           desc =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                            "Store listener records in ETS instead of Mnesia",
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                           provided_by =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                            rabbit,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                           stability =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                            stable},
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                        nodes =>
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                                                                         ['rabbit@testbed-node-2']}]
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0> Feature flags: on node `rabbit@testbed-node-2`:
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0> Feature flags:   {'EXIT',
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                      {noproc,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                          {gen_server2,call,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                              [worker_pool,
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                               {next_free,<13027.322.0>},
2022-09-27 08:44:08.308883+00:00 [error] <0.1270.0>                               infinity]}}}
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0> Feature flags: failed to enable `listener_records_in_ets`: {error,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                             {badrpc,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                              {'EXIT',
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                               {noproc,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                                {gen_server2,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                                 call,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                                 [worker_pool,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                                  {next_free,
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                                   <13027.322.0>},
2022-09-27 08:44:08.332759+00:00 [error] <0.1231.0>                                                                  infinity]}}}}}
2022-09-27 08:44:08.341515+00:00 [notice] <0.44.0> Application mnesia exited with reason: stopped
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> BOOT FAILED
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> ===========
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> Exception during startup:
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> 
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> error:{badmatch,{error,{badrpc,{'EXIT',{noproc,{gen_server2,call,[worker_pool,{next_free,<13027.322.0>},infinity]}}}}}}
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> 
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0>     rabbit:start/2, line 912
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0>     application_master:start_it_old/4, line 293
2022-09-27 08:44:08.341928+00:00 [error] <0.1089.0> 
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>   crasher:
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     initial call: application_master:init/4
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     pid: <0.1088.0>
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     registered_name: []
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     exception exit: {{badmatch,
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                       {error,
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                        {badrpc,
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                         {'EXIT',
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                          {noproc,
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                           {gen_server2,call,
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                            [worker_pool,
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                             {next_free,<13027.322.0>},
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                             infinity]}}}}}},
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>                      {rabbit,start,[normal,[]]}}
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>       in function  application_master:init/4 (application_master.erl, line 142)
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     ancestors: [<0.1087.0>]
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     message_queue_len: 1
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     messages: [{'EXIT',<0.1089.0>,normal}]
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     links: [<0.1087.0>,<0.44.0>]
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     dictionary: []
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     trap_exit: true
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     status: running
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     heap_size: 2586
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     stack_size: 28
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>     reductions: 221
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0>   neighbours:
2022-09-27 08:44:09.344037+00:00 [error] <0.1088.0> 
2022-09-27 08:44:09.344457+00:00 [notice] <0.44.0> Application rabbit exited with reason: {{badmatch,{error,{badrpc,{'EXIT',{noproc,{gen_server2,call,[worker_pool,{next_free,<13027.322.0>},infinity]}}}}}},{rabbit,start,[normal,[]]}}