amphi-ai / amphi-etl

Visual Data Transformation with Python Code Generation. Low-Code Python-based ETL.
https://amphi.ai
Other
893 stars 43 forks source link

Field/Column description #61

Open simonaubertbd opened 3 months ago

simonaubertbd commented 3 months ago

Hello,

A nice and common thing is having a field (or column) description (sometimes called comment). It exists for database and several file formats. It's also pretty common in ETL/Dataprep tools such as Alteryx, Dataïku, Orange Data Mining...

dbeaver_table_comments

image

Notable features : -visible on the pipeline -can come from the source (with a retrieve field description button on the input tool) -can optionnally be written to the output

Best regards,

Simon

tgourdel commented 3 months ago

Thanks Simon, it's interesting, haven't thought about adding metadata on fields in addition to name and type but that makes sense. Thanks for the suggestion