search

davidberenstein1957 / fast-sentence-transformers

Simply, faster, sentence-transformers
MIT License
140 stars 10 forks source link

embeddings of quantized models sometimes differ per device #8

Closed davidberenstein1957 closed 1 year ago

davidberenstein1957 commented 1 year ago

look into why this happens and how it can be fixed

davidberenstein1957 commented 1 year ago

This is probably caused by the newly created pool layer.