search

RiotGamesMinions / motherbrain

An orchestrator for Chef
Other
119 stars 18 forks source link

MB crash running cmd? #534

Closed galvarez1 closed 11 years ago

galvarez1 commented 11 years ago

Ok, this is the first time i've tried running an MB command in my env. The bootstrap succeeded, but i try the command: "mb gas gas_coherence_start --environment gil_test_5" and i get the stack trace below. Some env/version issue? This is with mb version 0.7.0.

[2013-05-30T23:26:28Z] PID[22677] TID[1e2plc] ANY: gas gas_coherence start --environment gil_test_5 [2013-05-30T23:26:28Z] PID[22677] TID[1e2plc] ANY: [2013-05-30T23:27:10Z] PID[22677] TID[1ivhbw] ERROR: MotherBrain::Application::SupervisionGroup crashed! RuntimeError: a group member went missing. This shouldn't be! /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/supervision_group.rb:103:in restart_actor' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/actor.rb:361:inhandle_exit_event' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/actor.rb:344:in block in handle_system_event' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/tasks.rb:42:inblock in initialize' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/tasks/task_fiber.rb:9:in `block in create'

reset commented 11 years ago

@galvarez1 can you provide the full stack trace? Not enough information in here to know why the application supervisor crashed. Thanks!

galvarez1 commented 11 years ago

That is the full stack trace. This is the entirety of the output from application.log. Is that WARN re: mysql2 something to worry about?

[2013-05-31T00:08:41Z] PID[23636] TID[1e9fd8] WARN: Error loading mysql gear: cannot load such file -- mysql2 [2013-05-31T00:08:42Z] PID[23636] TID[1i1md0] WARN: riot_team (0.9.55): cluster_bootstrap is now stack_order, and will be removed in motherbrain 1.0 [2013-05-31T00:08:42Z] PID[23636] TID[1i1md0] WARN: riot_ejabberd (0.1.3): cluster_bootstrap is now stack_order, and will be removed in motherbrain 1.0 [2013-05-31T00:08:42Z] PID[23636] TID[1i1md0] WARN: pvpnet_core (2.3.214): cluster_bootstrap is now stack_order, and will be removed in motherbrain 1.0 [2013-05-31T00:08:42Z] PID[23636] TID[1i1md0] WARN: riot_activemq (2.0.1): cluster_bootstrap is now stack_order, and will be removed in motherbrain 1.0 [2013-05-31T00:08:42Z] PID[23636] TID[1e9fd8] ANY: [2013-05-31T00:08:42Z] PID[23636] TID[1e9fd8] ANY: [2013-05-31T00:08:42Z] PID[23636] TID[1e9fd8] ANY: gas gas_coherence start --environment gil_test_5 [2013-05-31T00:08:42Z] PID[23636] TID[1e9fd8] ANY: [2013-05-31T00:09:40Z] PID[23636] TID[1i1nf2] ERROR: MotherBrain::Application::SupervisionGroup crashed! RuntimeError: a group member went missing. This shouldn't be! /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/supervision_group.rb:103:in restart_actor' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/actor.rb:361:inhandle_exit_event' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/actor.rb:344:in block in handle_system_event' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/tasks.rb:42:inblock in initialize' /usr/local/rbenv/versions/1.9.3-p385/lib/ruby/gems/1.9.1/gems/celluloid-0.14.0/lib/celluloid/tasks/task_fiber.rb:9:in `block in create'

reset commented 11 years ago

@galvarez1 can you gem install mysql2 on your machine, re-run the command, and tell me the results

galvarez1 commented 11 years ago

Same exact problem, except i didn't get the warning re: mysql2.

galvarez1 commented 11 years ago

Debug output in: https://gh.riotgames.com/gist/1512

reset commented 11 years ago

This was an issue with the recipe being executed. The error message posted had nothing to do with the actual issue. The falsely crashing supervision tree will be solved in a future version of Celluloid.