Closed robinkraft closed 12 years ago
OK, this makes sense to me. I can take care of this as well. How about an option like:
lein run --emr --type large --bid 0.05 --size 25 --zone us-east-1d
It can default to us-east-1d if no zone is supplied.
On Mon, Jul 23, 2012 at 6:53 PM, Robin Kraft < reply@reply.github.com
wrote:
Add an --availability-zone argument. Currently, I add a line like
--availability-zone us-east-1d
to hadoop/cluster.clj around line 228.Motivation:
Capacity and prices (and price stability) can be pretty different from one availability zone to the next. My current fav is
us-east-1d
, which has stable, low prices, and usually has enough spare capacity to supply 25 high-memory instances nearly on demand. But sometimes other availability zones are better suited to a given job, if prices have spiked in one zone or particularly if on-demand instances are needed.us-east-1a
has always had more than enough capacity even for a truly ginormous cluster.
Reply to this email directly or view it on GitHub: https://github.com/reddmetrics/forma-deploy/issues/6
Add an --availability-zone argument. Currently, I add a line like
--availability-zone us-east-1d
to hadoop/cluster.clj around line 228.Motivation:
Capacity and prices (and price stability) can be pretty different from one availability zone to the next. My current fav is
us-east-1d
, which has stable, low prices, and usually has enough spare capacity to supply 25 high-memory instances nearly on demand. But sometimes other availability zones are better suited to a given job, if prices have spiked in one zone or particularly if on-demand instances are needed.us-east-1a
has always had more than enough capacity even for a truly ginormous cluster.