OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
Affected module
Does it impact the UI, backend or Ingestion Framework?
Profiler error in BigQuery connection with ADC.
Describe the bug
After launch openmetadata_ingestion for metadata and lineage, both of them are okey. When launching the pipeline for profiler with Enable Debug Log enabled and Schema Filter Pattern point to only one schema, we get the error: {'Schema pattern not allowed: Bigquery_dev_3.xxx.business_zone.xxx': 'Schema pattern not allowed'}. Not getting the right profiler for this schema.
To Reproduce
Nomal profiler pipeline only include one schema of the database.
Expected behavior
get a full profiler of all columns and sample data
Affected module Does it impact the UI, backend or Ingestion Framework?
Profiler error in BigQuery connection with ADC.
Describe the bug After launch openmetadata_ingestion for metadata and lineage, both of them are okey. When launching the pipeline for profiler with
Enable Debug Log
enabled andSchema Filter Pattern
point to only one schema, we get the error:{'Schema pattern not allowed: Bigquery_dev_3.xxx.business_zone.xxx': 'Schema pattern not allowed'}
. Not getting the right profiler for this schema.To Reproduce
Nomal profiler pipeline only include one schema of the database.
Expected behavior get a full profiler of all columns and sample data
Version:
Additional context all roles for bigquery connection in documentation are granted.