Open rantler opened 3 years ago
It looks like there is some existing support in AWS for automatically pipelining data from S3 into Redshift:
https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/automate-data-loading-from-amazon-s3-to-amazon-redshift-using-aws-data-pipeline.html
If we supported publishing to CSV rather than SNS, we might be able to leverage that.
Thanks. There's https://aws.amazon.com/blogs/big-data/a-zero-administration-amazon-redshift-database-loader/ as well. All options we should consider.
It looks like there is some existing support in AWS for automatically pipelining data from S3 into Redshift:
https://docs.aws.amazon.com/prescriptive-guidance/latest/patterns/automate-data-loading-from-amazon-s3-to-amazon-redshift-using-aws-data-pipeline.html
If we supported publishing to CSV rather than SNS, we might be able to leverage that.