gouline / dbt-metabase

dbt + Metabase integration
https://pypi.org/project/dbt-metabase/
MIT License
448 stars 64 forks source link

dbt test synchronization #18

Closed z3z1ma closed 3 years ago

z3z1ma commented 3 years ago

Not sure if this is the right place for this but I have built functionality capable of synchronizing dbt tests to a designated collection in Metabase. The flip side of the process uses Metabase API to query each question in the designated collection flagging failures and collecting results to in turn be displayed on Metabase in a unit test dashboard.

Example collection with synchronized unit tests / schema tests / great expectations from dbt Jinja compiled tests. image

Example Dashboard from API collected results: image

Table links to Metabase questions where I can view the failing records: image

While I dont know if this falls into the scope of this project, I wanted to ask from the perspective of a deeper integration what your thoughts were. I have these processes running via Jenkins in a CI/CD env in production with good success. Even without collection synchronization to quickly view results, I havent seen much dbt test query parsing and tabular result generation. Maybe a mention of it from someone else who built an application wrapper.

gouline commented 3 years ago

Thanks for raising the issue. This is definitely cool but slightly outside of the scope of this project, mainly because it's basically misusing BI as a user interface for your CI/CD, which is a niche use case at best. Keep this separate for now and I will leave this issue open, so we can gauge interest from the community. If more people want this and/or either dbt or Metabase are more welcoming of this use case in future versions, we can think about merging it in.

gouline commented 3 years ago

No recent activity on this, so closing for now. If there's more interest on this in the future, we can re-open.