🔄 Revisit AWS DataZone

[bagg3rs]

User Story

As a Platform I want to provide a simple sharing mechanism for data owners So that data consumers and data owners have a secure and logged method of requesting access to data assets

Value / Purpose

• Amazon Data Zone has added a lot of new functionality around sharing data between data roles (admins or owners) and those looking for data (which could in the future come from find-moj-data
• Could allow data analysts to connect analysis tools to the data they need without configuring the datasource e.g. QuickSight
• Apply appropriate data governance to data assets
• DZ Projects use-case based grouping of teams, tools, and data and could fill the role of the Data Engineering Database Access
• DZ is now also in the London region which removes the limitation of only using IAM users and provides SSO

Additional Information

• See end to end use case between Data Producer and Consumer here
• Available DataZone API's

Definition of Done

• [ ] Review Projects as a way for teams to work on data together also see data-engineering-database-access as current method of giving teams access to the same data resources.
• [ ] Review data sharing features (Discovering, subscribing to, and consuming data in Amazon DataZone) and how users can discover these assets, request and gain access to these assets, and continue to use Amazon DataZone to govern, share, and analyse
• [ ] Review Amazon DataZone built-in blueprints A blueprint with which the environment is created defines what AWS tools and services (for example, AWS Glue or Amazon Redshift) members of the project to which the environment belongs can use as they work with assets in the Amazon DataZone catalog
• [ ] Review available API's and they could be consumed by our frontend.

[Gary-H9]

Captured my thoughts in this Slack Canvas. Note:

• The terraform-aws-provider was only merged three weeks ago (as of 15th April), so I don’t think this is very well developed. I can’t see any mention of it in the Terraform Registry so unsure what’s going on there.

[bagg3rs]

article here on data zone

[jacobwoffenden]

We will spin out meeting with AWS into another ticket.