search

nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
637 stars 116 forks source link

2. how to add/launch a hybrid cluster #215

Closed xiandong79 closed 6 years ago

xiandong79 commented 6 years ago
  1. how to add new slaves to an existing cluster with flintrock? 
$ flintrock --help

Commands:
  add-slaves     Add slaves to an existing cluster.
  1. how to add/launch a hybrid cluster, i.e., 4 machines with m4.large + 4 machines with m3.xlarge, even with 2 GPU machines with g2.lagre?
nchammas commented 6 years ago

Hi @xiandong79! It looks like you answered your first question.

With regards to the second question, it's currently not possible to launch a cluster with mixed instance types. There are a few related issues about this: #166, #138, #199.

I recommend following #199 for further updates on this issue. Before supporting arbitrary mixes of instance types (which I think is unlikely), we'd first want to support simply having the master and slaves be different instance types.