embeddings-benchmark / mteb

MTEB: Massive Text Embedding Benchmark
https://arxiv.org/abs/2210.07316
Apache License 2.0
1.97k stars 274 forks source link

Leaderboard: Add radar chart #1443

Open KennethEnevoldsen opened 1 week ago

KennethEnevoldsen commented 1 week ago

Not planned for the current release of the leaderboard, but it would be nice to have a radio chart for the plots. To make it clear where models excel. The radar plot could include task types, languages and/or domains.

It could either be placed where the description is now (moving the description up) or we could have it below the table.

Example of a radar chart radar_chart

A critique of radar chart: https://blog.scottlogic.com/2011/09/23/a-critique-of-radar-charts.html

There might be better plots available to access model capabilities quickly (though I think radar is a good fit on our case).