MinishLab / model2vec

Distill a Small Static Model from any Sentence Transformer
https://minishlab.github.io/
MIT License
413 stars 18 forks source link

feat: make encode_batch_fast optional #113

Closed stephantul closed 3 weeks ago

stephantul commented 3 weeks ago

If tokenizers < 0.20 is installed the code can still work, but we need a flag to know which function to call. I think this is worth supporting, because 0.20 is relatively new.

codecov[bot] commented 3 weeks ago

Codecov Report

Attention: Patch coverage is 78.94737% with 4 lines in your changes missing coverage. Please review.

Files with missing lines Patch % Lines
tests/test_model.py 75.00% 3 Missing :warning:
model2vec/model.py 83.33% 1 Missing :warning:
Files with missing lines Coverage Δ
tests/conftest.py 100.00% <100.00%> (ø)
model2vec/model.py 96.00% <83.33%> (-0.67%) :arrow_down:
tests/test_model.py 97.36% <75.00%> (-2.64%) :arrow_down: