jtriley / StarCluster

StarCluster is an open source cluster-computing toolkit for Amazon's Elastic Compute Cloud (EC2).
http://star.mit.edu/cluster
GNU Lesser General Public License v3.0
582 stars 308 forks source link

Possible to start a cluster from an ec2 instance #486

Open pintohutch opened 9 years ago

pintohutch commented 9 years ago

Hello,

I was wondering if it is possible, using starcluster, to create a cluster of slave nodes from a head node that is already running on ec2. Ideally, I'd like to have a micro-instance as the head node, and then be able to configure a cluster of slave nodes (of a different instance type, say, c3.8xlarge) using that instance as the head node.

Thanks.

meissnert commented 9 years ago

In your .starcluster/config file you can specify different instance types for the headnode & the slave nodes by using MASTER_INSTANCE_TYPE & NODE_INSTANCE_TYPE:

[cluster testcluster]
KEYNAME = mykey
CLUSTER_SIZE = x
CLUSTER_USER = sgeadmin
CLUSTER_SHELL = bash
NODE_IMAGE_ID = ami-xyz
NODE_INSTANCE_TYPE = c3.8xlarge
MASTER_INSTANCE_TYPE = t2.micro
...

Another possibility would be to create a cluster of size 1 with the desired instance type for the headnode, then use the starcluster client addnode function with the -I option to specify the instance type for the slave node. That's usually the way I boot up my cluster.

Cheers

rezuma commented 9 years ago

Hi did you ever get an answer to this?

Ramon

On Fri, Jan 9, 2015 at 1:09 PM, dclark87 notifications@github.com wrote:

Hello,

I was wondering if it is possible, using starcluster, to create a cluster of slave nodes from a head node that is already running on ec2. Ideally, I'd like to have a micro-instance as the head node, and then be able to configure a cluster of slave nodes (of a different instance type, say, c3.8xlarge) using that instance as the head node.

Thanks.

— Reply to this email directly or view it on GitHub https://github.com/jtriley/StarCluster/issues/486.

pintohutch commented 9 years ago

Ah ok, but there's no way to do it assuming you are sitting on the headnode already?