sentencepiece was removed as a required dependency for sentence-transformers, because most models don't require it anymore and it doesn't work well with Python 3.12 on Windows 11. Nowadays, we simply throw an error if it's required but not installed. However, the API Inference should have it installed to ensure that we can also run these models with slow tokenizers. I've verified locally that sentencepiece==0.2.0 works for e.g. that slovlo-v1 model.
Hello!
Pull Request overview
Details
See e.g. https://huggingface.co/rokn/slovlo-v1:![image](https://github.com/huggingface/api-inference-community/assets/37621491/756b6c6f-9d30-4d6f-959c-3cc28570526d)
sentencepiece
was removed as a required dependency forsentence-transformers
, because most models don't require it anymore and it doesn't work well with Python 3.12 on Windows 11. Nowadays, we simply throw an error if it's required but not installed. However, the API Inference should have it installed to ensure that we can also run these models with slow tokenizers. I've verified locally thatsentencepiece==0.2.0
works for e.g. thatslovlo-v1
model.