search

RiotGamesMinions / motherbrain

An orchestrator for Chef
Other
119 stars 18 forks source link

scary errors in log even though mb completes successfully #215

Closed davideilering closed 11 years ago

davideilering commented 11 years ago

Just tailing the logs (with -d option), it looks like there's problems with the MB run, but actually it's ok. This happens everytime I run MB no matter which command.

[2013-01-31T17:58:58Z] PID[38398] TID[zohi9w] DEBUG: Job (592ffe7f-5a9d-455a-886a-000000000000) success: [2013-01-31T17:58:58Z] PID[38398] TID[zohi9w] DEBUG: job (592ffe7f-5a9d-455a-886a-000000000000) transitioning to 'success' [2013-01-31T17:58:58Z] PID[38398] TID[zl7ux4] DEBUG: Terminating 22 actors... [2013-01-31T17:58:58Z] PID[38398] TID[znshuw] INFO: Config Manager stopping... [2013-01-31T17:58:58Z] PID[38398] TID[zoh5sg] ERROR: MotherBrain::Application crashed! RuntimeError: a group member went missing. This shouldn't be! /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/supervision_group.rb:99:in restart_actor' /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/actor.rb:355:inhandle_exit_event' /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/actor.rb:340:in block in handle_system_event' /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/tasks/task_fiber.rb:24:inblock in initialize' [2013-01-31T17:58:58Z] PID[38398] TID[znwp5k] INFO: Plugin Manager stopping... [2013-01-31T17:58:58Z] PID[38398] TID[zoh5sg] INFO: MotherBrain stopping... [2013-01-31T17:58:58Z] PID[38398] TID[zu8jo4] INFO: Provision Manager stopping... [2013-01-31T17:58:58Z] PID[38398] TID[zoh48w] INFO: Bootstrap Manager stopping... [2013-01-31T17:58:58Z] PID[38398] TID[znzsf4] INFO: Lock Manager stopping... [2013-01-31T17:58:58Z] PID[38398] TID[zny8sw] INFO: Node Querier stopping... [2013-01-31T17:58:58Z] PID[38398] TID[zo7ba8] ERROR: MotherBrain::Upgrade::Manager crashed! RuntimeError: a group member went missing. This shouldn't be! /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/supervision_group.rb:99:in restart_actor' /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/actor.rb:355:inhandle_exit_event' /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/actor.rb:340:in block in handle_system_event' /Users/deilering/.rvm/gems/ruby-1.9.3-p286/gems/celluloid-0.12.4/lib/celluloid/tasks/task_fiber.rb:24:inblock in initialize' [2013-01-31T17:58:58Z] PID[38398] TID[zl7ux4] DEBUG: Shutdown completed cleanly

justincampbell commented 11 years ago

@reset has a branch in progress that should solve most or all of these

jhowarth commented 11 years ago

@reset Was the branch Justin references above merged in?

reset commented 11 years ago

what a fucking mess this used to be. Yes, that branch is merged in and it should nearly all be cleaned up. Anything which isn't throwing a friendly error and updating a job needs to have their exceptions handled.