michaelfeil / infinity

Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip
https://michaelfeil.github.io/infinity/
MIT License
1.31k stars 96 forks source link

refactor `BatchHandler` into `ModelWorker` #202

Closed michaelfeil closed 5 months ago

codecov-commenter commented 5 months ago

Codecov Report

Attention: Patch coverage is 94.44444% with 5 lines in your changes are missing coverage. Please review.

Project coverage is 73.99%. Comparing base (4019035) to head (7837c85).

Files Patch % Lines
...finity_emb/infinity_emb/inference/batch_handler.py 94.18% 5 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #202 +/- ## ========================================== + Coverage 73.71% 73.99% +0.27% ========================================== Files 32 32 Lines 1849 1884 +35 ========================================== + Hits 1363 1394 +31 - Misses 486 490 +4 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.