search

embeddings-benchmark / leaderboard

Code for the MTEB leaderboard
https://hf.co/spaces/mteb/leaderboard
16 stars 10 forks source link

Cross-Encoder filtering not working #57

Open Muennighoff opened 1 week ago

Muennighoff commented 1 week ago

Seems like filtering for Cross-Encoders is not working anymore 🤔 Maybe cc @orionw has an idea? (originally raised here https://huggingface.co/spaces/mteb/leaderboard/discussions/145 cc @guillaumegrosjean)

Screenshot 2024-11-25 at 5 47 17 PM
orionw commented 1 week ago

Thanks for raising this @guillaumegrosjean!

It used to work, not fully sure what would have changed. The models are there but can’t be filtered using the button.

Perhaps this was due to the issue about changing the operator from AND to OR? Not at a computer today, but I recall a previous GitHub issue about changing how we filter, perhaps this was the result.

We are switching to the v2 leaderboard soon, but we should make sure it works there also (cc @x-tabdeveloping as an FYI).