Support for MPNet based models

elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)

Apache License 2.0

1.38k stars 103 forks source link

Support for MPNet based models #219

Open SteffenDE opened 1 year ago

SteffenDE commented 1 year ago

Although Bumblebee already supports many sentence transformer models, the MPNet based ones are currently not usable. Since these are also quite popular on huggingface and also perform the best according in the sbert benchmark, it would be great if Bumblebee could support these too.

See for example: sentence-transformers/all-mpnet-base-v2

SteffenDE commented 1 year ago

For anyone wanting to run unsupported models like all-mpnet-base-v2 have a look at this livebook that uses Ortex:

https://gist.github.com/SteffenDE/893a9f00b4b95a2d0df3331a665b67ba

snewcomer commented 4 weeks ago

I'm interested in helping put this into a release. I'm guessing for implementation, this is a good example to follow?

jonatanklosko commented 4 weeks ago

Hey @snewcomer, I think so! I also saw this recent article that you may find useful to get more context :)