search

RiotGamesMinions / motherbrain

An orchestrator for Chef
Other
119 stars 18 forks source link

Error while provisioning #605

Closed galvarez1 closed 11 years ago

galvarez1 commented 11 years ago

I'm sure i'm doing something wrong, getting the below while trying to provision and getting a 406. So the main thing is i have no idea what the real problem is. At least better error reporting so that one understands what the problem is?

This is my provision json:

$ cat provision { "provisioner" : "aws", "options" : { "access_key": "BAJ7TFQ9FUBS0ZWPYRY7S", "secret_key" : "something something", "image_id" : "emi-BDA1360E", "key_name" : "gil_euca_key", "availability_zone" : "lax2" }, "nodes": [ { "groups": [], "type": "m1.medium", "count": 1 } ] }

And btw, note that i was able to provision by using euca cli tools:

euca-run-instances emi-BDA1360E -n $1 -t m1.large -k gil_euca_key

and i was able to bootstrap and use these nodes just fine.

[2013-07-24T02:49:04Z] PID[24876] TID[1fl4iq] INFO: Job (bbda2c98-f7c9-4a2c-82a9-000000170000) status: Starting provision [2013-07-24T02:49:04Z] PID[24876] TID[1fl4iq] INFO: Job (bbda2c98-f7c9-4a2c-82a9-000000170000) status: Validating manifest options [2013-07-24T02:49:04Z] PID[24876] TID[1fl4iq] INFO: Job (bbda2c98-f7c9-4a2c-82a9-000000170000) status: Creating instances [2013-07-24T02:49:04Z] PID[24876] TID[1fl4iq] INFO: Job (bbda2c98-f7c9-4a2c-82a9-000000170000) status: Creating 1 m1.medium instance on 10.20.36.42 [2013-07-24T02:49:05Z] PID[24876] TID[1dihre] ERROR: MotherBrain::Provisioner::AWS crashed! Excon::Errors::NotAcceptable: Expected(200) <=> Actual(406 Not Acceptable) /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/excon-0.25.3/lib/excon/middlewares/expects.rb:10:in response_call' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/excon-0.25.3/lib/excon/middlewares/response_parser.rb:8:inresponse_call' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/excon-0.25.3/lib/excon/connection.rb:349:in response' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/excon-0.25.3/lib/excon/connection.rb:247:inrequest' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/fog-1.10.1/lib/fog/core/connection.rb:21:in request' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/fog-1.10.1/lib/fog/aws/compute.rb:384:in_request' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/fog-1.10.1/lib/fog/aws/compute.rb:379:in request' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/fog-1.10.1/lib/fog/aws/requests/compute/run_instances.rb:119:inrun_instances' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/motherbrain-0.9.1/lib/mb/provisioners/aws.rb:249:in run_instances' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/motherbrain-0.9.1/lib/mb/provisioners/aws.rb:230:inblock in create_instances' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/motherbrain-0.9.1/lib/mb/provisioners/aws.rb:229:in each' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/motherbrain-0.9.1/lib/mb/provisioners/aws.rb:229:increate_instances' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/motherbrain-0.9.1/lib/mb/provisioners/aws.rb:28:in up' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/celluloid-0.14.1/lib/celluloid/calls.rb:25:inpublic_send' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/celluloid-0.14.1/lib/celluloid/calls.rb:67:in dispatch' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/celluloid-0.14.1/lib/celluloid/actor.rb:326:inblock in handle_message' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/celluloid-0.14.1/lib/celluloid/tasks.rb:42:in block in initialize' /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/celluloid-0.14.1/lib/celluloid/tasks/task_fiber.rb:11:inblock in create' [2013-07-24T02:49:05Z] PID[24876] TID[1fl4iq] FATAL: Job (bbda2c98-f7c9-4a2c-82a9-000000170000) failure: Expected(200) <=> Actual(406 Not Acceptable) [2013-07-24T02:49:05Z] PID[24876] TID[1fl4iq] DEBUG: job (bbda2c98-f7c9-4a2c-82a9-000000170000) transitioning to 'failure' [2013-07-24T02:49:05Z] PID[24876] TID[18w2do] DEBUG: Terminating 104 actors... [2013-07-24T02:49:05Z] PID[24876] TID[19iy4y] ERROR: MotherBrain::Application::SupervisionGroup crashed! RuntimeError: a group member went missing. This shouldn't be! /usr/local/rbenv/versions/1.9.3-p392/lib/ruby/gems/1.9.1/gems/celluloid-0.14.1/lib/celluloid/supervision_group.rb:103:in `restart_actor'

andrewGarson commented 11 years ago

@galvarez1 you are using m1.large with the euca2ools but m1.medium with MB. Its very possible that EMI is too big for a medium box.

Change your provision to use m1.large and try again.

andrewGarson commented 11 years ago

@galvarez1 its also a really bad idea to share your secret_key in a github issue....you should edit your message

galvarez1 commented 11 years ago

Yep, that was it, i changed it to large and it provisioned fine. Thanks!

And i did edit out the secret key

galvarez1 commented 11 years ago

Not so fast. The real issue was about "better error reporting". Can we do that? And how can an issue be re-opened?

andrewGarson commented 11 years ago

@galvarez1 I created a new ticket to track this enhancement. See above