search

elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)
Apache License 2.0
1.28k stars 92 forks source link

Support for MPNet based models #219

Open SteffenDE opened 1 year ago

SteffenDE commented 1 year ago

Although Bumblebee already supports many sentence transformer models, the MPNet based ones are currently not usable. Since these are also quite popular on huggingface and also perform the best according in the sbert benchmark, it would be great if Bumblebee could support these too.

See for example: sentence-transformers/all-mpnet-base-v2

SteffenDE commented 1 year ago

For anyone wanting to run unsupported models like all-mpnet-base-v2 have a look at this livebook that uses Ortex:

https://gist.github.com/SteffenDE/893a9f00b4b95a2d0df3331a665b67ba