search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.29k stars 997 forks source link

Correlation Analysis of Test Failures #12198

Open TeddyCr opened 1 year ago

TeddyCr commented 1 year ago

In an effort to lower time to resolution on data incident we should provide correlation analysis of test failure by surfacing the dimensions in the table that explain the most the failure

e.g. if test case checking for column C to be not null fails, we should provide information (if any exists) about which dimension (from column A or B) explains the failure (i.e. 100% of null value come from dimension foo in column A).

jayasekharreddy-telluri commented 1 year ago

can i work on these issue

TeddyCr commented 1 year ago

hey @jayasekharreddy-telluri for sure. That would be awesome. I'll assign it to you. Let us know if you have any questions.