UKPLab / sentence-transformers

Multilingual Sentence & Image Embeddings with BERT
https://www.SBERT.net
Apache License 2.0
14.38k stars 2.39k forks source link

https://seb.sbert.net down? #1888

Open dmlls opened 1 year ago

dmlls commented 1 year ago

Hi, I'm trying to access the evaluation results of the model all-mpnet-base-v2 through https://seb.sbert.net, as indicated in the model card:

all-mpnet-base-v2

However the site seems to be down. Is there any other way I can access the results?

ggssgs commented 1 year ago

I'm also looking for the detailed benchmark info in the pretrained model list image Can any one help to figure out a way to see it? Thanks!

nreimers commented 1 year ago

Have a look at MTEB: https://huggingface.co/spaces/mteb/leaderboard

dmlls commented 1 year ago

@nreimers thank you!

Maybe the docs should be updated accordingly? I could help with that.

mfgeary commented 1 year ago

Has any progress been made with this? I am trying to evaluate the results of the model stsb-mpnet-base-v2, but I can't find any information anywhere. It is not included in the MTEB leaderboard. I am redirected to this link https://seb.sbert.net/ but it does not load.

As an update, you can access this info through the Wayback Machine if you are really interested. Here is a link that worked for me http://web.archive.org/web/20210628230426/https://sbert.net/docs/pretrained_models.html