search

michaelfeil / infinity

Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip
https://michaelfeil.github.io/infinity/
MIT License
1.32k stars 97 forks source link

Refactor: async usage in BatchHandler #56

Open michaelfeil opened 9 months ago

codecov-commenter commented 9 months ago

Codecov Report

Attention: 6 lines in your changes are missing coverage. Please review.

Comparison is base (b1284e0) 86.17% compared to head (6dfce70) 87.27%.

Files Patch % Lines
libs/infinity_emb/infinity_emb/inference/queue.py 88.88% 3 Missing :warning:
...finity_emb/infinity_emb/inference/caching_layer.py 80.00% 2 Missing :warning:
libs/infinity_emb/infinity_emb/primitives.py 95.65% 1 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #56 +/- ## ========================================== + Coverage 86.17% 87.27% +1.09% ========================================== Files 27 27 Lines 1259 1257 -2 ========================================== + Hits 1085 1097 +12 + Misses 174 160 -14 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.