search

data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
https://data-dot-all.github.io/dataall/
Apache License 2.0
230 stars 81 forks source link

Ability to catalog API Endpoints #345

Open chamiles opened 1 year ago

chamiles commented 1 year ago

Customer has several REST API's they would like to catalog along side current glue datasets and store metadata of those endpoints. Would like a way to submit a sharing request for getting credentials via data.all and have them automatically store them in secrets manager that can be used in the consumer account later when building a pipeline or notebook.

Ability to add catalog item type of API endpoint, with webhook option to request sharing. once access is granted Credentials should automatically be stored in the consumer requesting account for later use with a pipeline.

dlpzx commented 1 year ago

Thank you @chamiles, this is a very powerful feature in comparison with the implementation complexity that it takes. We will discuss it internally. Do not hesitate to share with us any design or requirements!

marjet26 commented 1 year ago

This feature would be useful for our customer, as well.