nchammas / flintrock

A command-line tool for launching Apache Spark clusters.
Apache License 2.0
636 stars 116 forks source link

Add Terraform templates to manage private VPC for testing #302

Closed nchammas closed 4 years ago

nchammas commented 4 years ago

This PR adds some quick and dirty Terraform templates to manage a private VPC with all the necessary infrastructure in place, like a NAT gateway. This makes it easier to test the work in #296 and any future efforts that impact Flintrock's behavior in private VPCs.

I tried to just manually create this infrastructure and keep it lying around, but it's a bit expensive to keep a NAT gateway running all the time, and destroying/recreating the gateway manually requires updating route tables manually too. So I figured it would be better to just automate the creation of this infrastructure so I can set it up and tear it down as needed.

TODO: