search

open-metadata / OpenMetadata

OpenMetadata is a unified metadata platform for data discovery, data observability, and data governance powered by a central metadata repository, in-depth column level lineage, and seamless team collaboration.
https://open-metadata.org
Apache License 2.0
5.63k stars 1.06k forks source link

increase the server response rate for endpoint "GET /v1/dataQuality/testCases" #15426

Closed Alexandr-Nedomets closed 7 months ago

Alexandr-Nedomets commented 9 months ago

Affected module

Module openmetadata-service class org.openmetadata.service.security.mask.PIIMasker method getTestCases(...)

Describe the bug The bug affected the performance of the endpoint "GET /v1/dataQuality/testCases". the same object"Table" is requested in a loop for each object "TestCase" This causes the response speed from the server to drop Method that affects performance To Reproduce

Screenshots or steps to reproduce

Expected behavior Faster response from the server for endpoint "GET /v1/dataQuality/testCases".

Version:

Additional context Add any other context about the problem here.

Alexandr-Nedomets commented 9 months ago

I'm ready to do this issue if all ok, assign to me

TeddyCr commented 8 months ago

Hey @Alexandr-Nedomets just assigned it to you.

the same object"Table" is requested in a loop for each object "TestCase" Regarding 👆keep in mind that when requesting test cases there is no guarantees the test cases belong to the same table. Hence, ResultList<TestCase> testCases can hold test cases from different tables.

pmbrull commented 7 months ago

closed by https://github.com/open-metadata/OpenMetadata/pull/15442