open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.39k stars 1.02k forks source link

Backend: Api end point for test case states count (pass/failed/aborted.) #15593

Closed ShaileshParmar11 closed 5 months ago

ShaileshParmar11 commented 7 months ago

currently, for showing states for all the columns and table we need to fetch all the test cases of that table and column and show the count for pass failed and aborted, With the help of a new endpoint, we can avoid heavy calls from the UI side and get only the required information. API should contains the count details of table and column test cases

TeddyCr commented 7 months ago

@ShaileshParmar11 you have an endpoint for that will compute this info from ES.

/v1/dataQuality/testSuites/executionSummary?testSuiteId={id}

You need to call this from the DQ page of the entity. You already use this endpoint on this page https://sandbox.open-metadata.org/data-quality

ShaileshParmar11 commented 7 months ago

Thanks @TeddyCr for the details, however, the requirement here is to call a single API to fetch all the counts related to the table and its columns, example: if the table has 5 columns then, UI will make only a single call, and BE will provide all the counts for the table and its columns with bifurcated with pass/failed/aborted

TeddyCr commented 7 months ago

You mean you want a count broken down by column / table? e.g.

[
{"fqn": "XYZ", passed: 4, failed: 5},
{"fqn": "XYZ.colA", passed: 4, failed: 5}
....
]
ShaileshParmar11 commented 7 months ago

correct @TeddyCr, to show the counts of the column tests in schema tab https://github.com/open-metadata/OpenMetadata/issues/14440

harshach commented 7 months ago

@TeddyCr lets take in entityFQN as the parameter and return all the tests at table or column level back along with their statuses

harshach commented 6 months ago

@TeddyCr are you planning to finish this up?

TeddyCr commented 6 months ago

Yep that is the plan