search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.55k stars 1.05k forks source link

Create a separation between Metadata Project ID & Query execution Project ID for BigQuery connector #17950

Open kalistussandy opened 1 month ago

kalistussandy commented 1 month ago

Feature Initial discussion in support channel on OpenMetadata slack.

Describe the task Need to have options to separate between query project_id and billing project_id for BigQuery connector.

Example: bigquery-project-a : the source project where the data is stored bigquery-project-b : billing project

The goal is to get the metadata from bigquery-project-a , but the ingestion query from OMD is billed to/using bigquery-project-b.