search

awslabs / aws-ddk

An open source development framework to help you build data workflows and modern data architecture on AWS.
https://awslabs.github.io/aws-ddk/
Apache License 2.0
256 stars 20 forks source link

(core) RedshiftServerlessFactory DDK resource #187

Open wscalioni opened 1 year ago

wscalioni commented 1 year ago

Is your feature request related to a problem? Please describe. Inability to spin up a Redshift Serverless cluster for data processing, fast architecture pattern deployment

Describe the solution you'd like Being able to deploy Redshift Serverless through RedshiftServerlessFactory() DDK resource and then further Data Stages (Ingestion from a number of sources such as S3 and DynamoDB by using COPY command), and leverage features such as Redshift ML, Redshift Streaming Ingestion from Kinesis Data Streams, Automatic MVs, etc.

Describe alternatives you've considered AthenaSQLSstage as an alternate SQL query engine pattern, but Redshift Serverless is suitable for advanced cloud-native DW use cases as described above.

Additional context N/A

P.S. Please Don't attach files. Add code snippets directly in the message body instead.

malachi-constant commented 1 year ago

Hi @wscalioni thanks for opening this. I think this is worthy of an implementation and I'll add to the backlog.