Sample data not ingested in deltalake connector

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.

https://open-metadata.org

Apache License 2.0

5.67k stars 1.06k forks source link

Sample data not ingested in deltalake connector #4973

Open ulixius9 opened 2 years ago

ulixius9 commented 2 years ago

Affected module Ingestion Framework

Describe the bug

To Reproduce Ingest Deltalake Connector

pmbrull commented 2 years ago

WE need to figure out how (and if) to run the profiler on non-SQA sources cc @TeddyCr

pmbrull commented 2 years ago

to be validated after https://github.com/open-metadata/OpenMetadata/issues/7449

harshach commented 8 months ago

@TeddyCr whats plan around non SQA sources?

TeddyCr commented 8 months ago

We started the work progressively. We added support for:

data lake
Mongo
BigTable

The plan is to keep addressing the issue based on community feedback and keep it open as "Good first issue" for community contributor 😊