search

davidberenstein1957 / fast-sentence-transformers

Simply, faster, sentence-transformers
MIT License
132 stars 10 forks source link

Version conflict with onnxruntime #16

Closed remydeshayes closed 4 months ago

remydeshayes commented 11 months ago

Hi 👋

Installed latest version of fast-sentence-transformers through pip on a fresh environment running python 3-10.

model = SentenceTransformer("all-MiniLM-L6-v2", device='cpu', quantize=True) returned quantize_dynamic() got an unexpected keyword argument 'optimize_model'.

This argument was removed by microsoft in June 2023 in this commit url which was then part of onnxruntime release 1.16.0

Probable causes of bug: It seems that the install is now bringing onnx 1.15 and onnxruntime 1.16.1as a dependency which causes the error above.

davidberenstein1957 commented 4 months ago

Sorry for the late response but I've got good news! Sentence Transformers has an awesome maintainer again @tomaarsen, along with awesome ONNX integrations through optimum, therefore I decided to archive this project. https://github.com/UKPLab/sentence-transformers. Take a look here https://www.philschmid.de/optimize-sentence-transformers.