search

data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
https://data-dot-all.github.io/dataall/
Apache License 2.0
226 stars 82 forks source link

Ability to manage and share views created from Athena #1028

Open awskaran opened 6 months ago

awskaran commented 6 months ago

Is your feature request related to a problem? Please describe. I want data analysts to have capability to use Athena for querying data and creating views. The views get registered in Glue data catalog as presto views but are not visible on the frontend

Describe the solution you'd like I would like data analysts to be able to create views and share them like other datastes.

Describe alternatives you've considered

Additional context

P.S. Please Don't attach files. Add code snippets directly in the message body instead.

dlpzx commented 6 months ago

Hi @awskaran sorry for the late response. In the current version, by design, only Glue tables whose data is stored in the Dataset S3 bucket can be synced. The reason is that we can ensure that the S3 Bucket of the dataset has been registered by data.all in Lake Formation. We need to evaluate what would happen when we try to access the data and share a Glue view that the data is in other S3 buckets.

I will flag this issue as high importance so that we do the assessment.

sandeephs1 commented 4 months ago

Hi @dlpzx we have a similar requirement of creating a view and should be shareable, run queries.

Required Datasets can be within a single environment

is this feature available?

Error message while creating the view Insufficient Lake Formation permission(s) on test_sales_vw (Service: AmazonDataCatalog; Status Code: 400; Error Code: AccessDeniedException; Request ID: e85862ed-8c4c-4941-8c0d-def40c4179fb; Proxy: null)