open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.59k stars 1.05k forks source link

Support clone operations for BQ lineage #18637

Open DovileKr opened 1 week ago

DovileKr commented 1 week ago

Is your feature request related to a problem? Please describe. Data Lineage is not captured for GCP BQ Table Clone Operations.

Describe the solution you'd like Q Table Clone Operation in Information Schema Jobs seems to have all the information to extract lineage, however it doesn't seem to create one.

Information Schema Jobs data

Describe alternatives you've considered Have to post this manually - not a prefered option, existing BQ extractor already uses Information Schema Jobs

Additional context Add any other context or screenshots about the feature request here.