Top1 vs Top2 of same model

embeddings-benchmark / arena

Code for the MTEB Arena

https://hf.co/spaces/mteb/arena

14 stars 6 forks source link

Top1 vs Top2 of same model #39

Open Muennighoff opened 2 months ago

Muennighoff commented 2 months ago

Cool idea from @KarelDO

Add a feature for anonymous battles where it will be the top1 vs the top2 retrieved document of the same model. This would mostly be really useful preference data. Not so sure how useful for the leaderboard though.