data-dot-all / dataall

A modern data marketplace that makes collaboration among diverse users (like business, analysts and engineers) easier, increasing efficiency and agility in data projects on AWS.
https://data-dot-all.github.io/dataall/
Apache License 2.0
236 stars 82 forks source link

Glue Databrew Pipelines #343

Open chamiles opened 1 year ago

chamiles commented 1 year ago

Two customers would like to have the ability to easily create pipelines using databrew and having a easy to use GUI to build data preparations that can publish a dataset back into data.all catalog.

Very similar to the ability to create a notebook, would be nice to create a databrew project and then be able to link directly to it and make modifications as needed. also should be able to quickly see status and information about project from data.all interface

We believe this could be a play feature by itself rather than in the pipeline section, but open to ideas

marjet26 commented 1 year ago

This feature would be useful for our customer, as well.