Replace dataset glue-handler custom resource by CDK constructs

data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.

https://data-dot-all.github.io/dataall/

Apache License 2.0

236 stars 82 forks source link

Replace dataset glue-handler custom resource by CDK constructs #381

Closed dlpzx closed 1 year ago

dlpzx commented 1 year ago

When a dataset is deployed we use a custom resource to create a Glue Database and grant permissions to the database. Now several constructs of CDK enable us to replace the custom resource. https://docs.aws.amazon.com/cdk/api/v2/python/aws_cdk.aws_lakeformation/CfnPermissions.html

Describe the solution you'd like Easier management of dataset resources avoiding custom resources.

P.S. Don't attach files. Please, prefer add code snippets directly in the message body.

anmolsgandhi commented 1 year ago

Our customized custom resource cannot be directly replaced by CDK construct