search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
4.87k stars 933 forks source link

Add support to read more than one run_results.json file #16261

Open Larissa-Rocha opened 2 months ago

Larissa-Rocha commented 2 months ago

Feature If I have different pipelines running different models in my dbt project, they will produce different run_results.json. I would like to be able to import both when adding dbt ingestion so they can populate the tables they refer to.

Describe the task I have one dbt project with a single manifest.json and catalog.json. But I have 2 different pipelines that generate two different run_results.json. And all of these point to a single database.

SumanMaharana commented 2 months ago

I'll be working on this