search

amphi-ai / amphi-etl

Python-based Low-code ETL for data manipulation and transformation. Generates Python code you can deploy anywhere.
https://amphi.ai
Other
773 stars 33 forks source link

Field/Column description #61

Open simonaubertbd opened 1 month ago

simonaubertbd commented 1 month ago

Hello,

A nice and common thing is having a field (or column) description (sometimes called comment). It exists for database and several file formats. It's also pretty common in ETL/Dataprep tools such as Alteryx, Dataïku, Orange Data Mining...

dbeaver_table_comments

image

Notable features : -visible on the pipeline -can come from the source (with a retrieve field description button on the input tool) -can optionnally be written to the output

Best regards,

Simon

tgourdel commented 1 month ago

Thanks Simon, it's interesting, haven't thought about adding metadata on fields in addition to name and type but that makes sense. Thanks for the suggestion