reddmetrics / forma-deploy

Deployer for the FORMA Clojure code.
4 stars 0 forks source link

optional availability zone argument #6

Closed robinkraft closed 12 years ago

robinkraft commented 12 years ago

Add an --availability-zone argument. Currently, I add a line like --availability-zone us-east-1d to hadoop/cluster.clj around line 228.

Motivation:

Capacity and prices (and price stability) can be pretty different from one availability zone to the next. My current fav is us-east-1d, which has stable, low prices, and usually has enough spare capacity to supply 25 high-memory instances nearly on demand. But sometimes other availability zones are better suited to a given job, if prices have spiked in one zone or particularly if on-demand instances are needed. us-east-1a has always had more than enough capacity even for a truly ginormous cluster.

dpetrovics commented 12 years ago

OK, this makes sense to me. I can take care of this as well. How about an option like:

lein run --emr --type large --bid 0.05 --size 25 --zone us-east-1d

It can default to us-east-1d if no zone is supplied.

On Mon, Jul 23, 2012 at 6:53 PM, Robin Kraft < reply@reply.github.com

wrote:

Add an --availability-zone argument. Currently, I add a line like --availability-zone us-east-1d to hadoop/cluster.clj around line 228.

Motivation:

Capacity and prices (and price stability) can be pretty different from one availability zone to the next. My current fav is us-east-1d, which has stable, low prices, and usually has enough spare capacity to supply 25 high-memory instances nearly on demand. But sometimes other availability zones are better suited to a given job, if prices have spiked in one zone or particularly if on-demand instances are needed. us-east-1a has always had more than enough capacity even for a truly ginormous cluster.


Reply to this email directly or view it on GitHub: https://github.com/reddmetrics/forma-deploy/issues/6