DoSomething / infrastructure

🐄 DoSomething.org's infrastructure, managed by Terraform.
MIT License
3 stars 2 forks source link

Experimental: Configure AWS Glue via Terraform. #259

Closed DFurnes closed 4 years ago

DFurnes commented 4 years ago

What's this PR do?

This pull request explores configuring AWS Glue with Terraform. We're considering this as an alternate option to ingest Bertly's S3 bucket into Quasar, since it has less up-front cost than Fivetran.

How should this be reviewed?

Not ready for review yet, just pushing up before the long weekend! 🗽

Any background context you want to provide?

This is not necessarily something that we'll be going forward with, but I'm pushing it up for illustration when we consider the pros & cons of different options for getting Bertly (and other) S3 sources into our warehouse.

Relevant tickets

References Pivotal #172652716.

Checklist