open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.13k stars 975 forks source link

Feat: Foreign keys and visual lineage #14237

Open rparfig opened 9 months ago

rparfig commented 9 months ago

Is your feature request related to a problem? Please describe. The lineage feature is great but it would be better if it could show the relationship between a data asset and other objects also captured in an ingestion.

Describe the solution you'd like For instance, the constraints are listed in the schema description of a table, but they are not present in the lineage tab. A visual representation of these relationships as part of the lineage would be an excellent addition so it is easier to identify the several ramifications / relationship that a table, view or any other data asset has

Describe alternatives you've considered I am considering the use of the lineage option through the API but it would be great if this could be done automatically. The feature is present in commercial products, so this implementing this feature in Openmetadata would be a game changer.

Additional context

image image

harshach commented 9 months ago

@rparfig lineage is about what columns and tables are derived which upstream tables. We are not going to display schema relations in lineage. This is completely different feature

rparfig commented 9 months ago

I understand. Thank you for clarifying. Would this then be consider as a feature to implement in the future? Exposing these dependencies in a graphical fashion allows for the analysis of dependencies between data assets, so it would be useful. Thank you!