perryqh / db_blaster

MIT License
0 stars 1 forks source link

Feature suggestion - Add support for CSV export to S3 #17

Open rantler opened 3 years ago

rantler commented 3 years ago

It looks like there is some existing support in AWS for automatically pipelining data from S3 into Redshift:

https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/automate-data-loading-from-amazon-s3-to-amazon-redshift-using-aws-data-pipeline.html

If we supported publishing to CSV rather than SNS, we might be able to leverage that.

perryqh commented 3 years ago

Thanks. There's https://aws.amazon.com/blogs/big-data/a-zero-administration-amazon-redshift-database-loader/ as well. All options we should consider.