michaelfeil / infinity

Infinity is a high-throughput, low-latency REST API for serving text-embeddings, reranking models and clip
https://michaelfeil.github.io/infinity/
MIT License
1.32k stars 97 forks source link

Add optimum[onnx] #68

Closed michaelfeil closed 8 months ago

michaelfeil commented 8 months ago

Closes #58

codecov-commenter commented 8 months ago

Codecov Report

Attention: 36 lines in your changes are missing coverage. Please review.

Comparison is base (0fc2b61) 87.94% compared to head (cdd8c98) 86.64%.

Files Patch % Lines
...nity_emb/infinity_emb/transformer/utils_optimum.py 66.66% 21 Missing :warning:
...b/infinity_emb/transformer/crossencoder/optimum.py 81.08% 7 Missing :warning:
...y_emb/infinity_emb/transformer/embedder/optimum.py 91.66% 4 Missing :warning:
...inity_emb/infinity_emb/transformer/acceleration.py 50.00% 2 Missing :warning:
...ibs/infinity_emb/infinity_emb/transformer/utils.py 77.77% 2 Missing :warning:

:exclamation: Your organization needs to install the Codecov GitHub app to enable full functionality.

Additional details and impacted files ```diff @@ Coverage Diff @@ ## main #68 +/- ## ========================================== - Coverage 87.94% 86.64% -1.30% ========================================== Files 24 27 +3 Lines 1070 1228 +158 ========================================== + Hits 941 1064 +123 - Misses 129 164 +35 ```

:umbrella: View full report in Codecov by Sentry.
:loudspeaker: Have feedback on the report? Share it here.