argilla-io / argilla

Argilla is a collaboration tool for AI engineers and domain experts to build high-quality datasets
https://docs.argilla.io
Apache License 2.0
4k stars 378 forks source link

[PERF][IMPROVEMENT] argilla server: improve computation for dataset progress and metrics #5618

Closed frascuchon closed 1 month ago

frascuchon commented 1 month ago

Description

Computing dataset progress and metrics using the search engine drastically reduces the time required to run the Argilla server in HF spaces when persistent storage is enabled.

TODO

Type of change

How Has This Been Tested

Checklist

codecov[bot] commented 1 month ago

Codecov Report

Attention: Patch coverage is 95.00000% with 2 lines in your changes missing coverage. Please review.

Project coverage is 91.21%. Comparing base (eb6741e) to head (79a578c). Report is 1 commits behind head on develop.

Files with missing lines Patch % Lines
...la-server/src/argilla_server/search_engine/base.py 77.77% 2 Missing :warning:
Additional details and impacted files ```diff @@ Coverage Diff @@ ## develop #5618 +/- ## =========================================== - Coverage 91.22% 91.21% -0.02% =========================================== Files 145 145 Lines 6051 6065 +14 =========================================== + Hits 5520 5532 +12 - Misses 531 533 +2 ``` | [Flag](https://app.codecov.io/gh/argilla-io/argilla/pull/5618/flags?src=pr&el=flags&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=argilla-io) | Coverage Δ | | |---|---|---| | [argilla-server](https://app.codecov.io/gh/argilla-io/argilla/pull/5618/flags?src=pr&el=flag&utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=argilla-io) | `91.21% <95.00%> (-0.02%)` | :arrow_down: | Flags with carried forward coverage won't be shown. [Click here](https://docs.codecov.io/docs/carryforward-flags?utm_medium=referral&utm_source=github&utm_content=comment&utm_campaign=pr+comments&utm_term=argilla-io#carryforward-flags-in-the-pull-request-comment) to find out more.

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.