nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
636 stars 116 forks source link

Use the cluster security group for ip auth #311

Closed matthewfranglen closed 4 years ago

matthewfranglen commented 4 years ago

See https://github.com/nchammas/flintrock/issues/173

This PR makes the following changes:

I tested this PR by launching a cluster, logging into it, destroying it.

Fixes #173 This should avoid the RulesPerSecurityGroupLimitExceeded exception as the cluster security group is created just for the cluster, and so should have enough space to hold the rules.

I realise this probably needs more tests / changes and suchlike. I am very happy to receive feedback on how to make this acceptable.