search

awslabs / aws-ddk

An open source development framework to help you build data workflows and modern data architecture on AWS.
https://awslabs.github.io/aws-ddk/
Apache License 2.0
248 stars 20 forks source link

(core) LakeFormation DDK resource #73

Open pepijn-m opened 2 years ago

pepijn-m commented 2 years ago

Is your idea related to a problem? Please describe. It would be great if DDK could also help with setting up a data lake using LakeFormation. Currently we are stuck using an L1 construct of AWS CDK.

Describe the solution you'd like An opinionated DDK resource that can be used for setting up the data lake following the best practices, including: s3 setup, folder setup, archival, data cataloguing, user access mgmt, ... It could be integrated with a standard set of staged to curate the data and expose it via various consumption services.

P.S. Don't attach files. Please, prefer add code snippets directly in the message body.

malachi-constant commented 1 year ago

https://github.com/aws-samples/aws-lakeformation-access-controls-automation/tree/main/automated-deployment - probably can take certain things from this example