search

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.54k stars 182 forks source link

Proposal: Describe metrics in Wiki with more details #124

Open FabianHertwig opened 1 year ago

FabianHertwig commented 1 year ago

I would like to understand the metrics better and therefore it would be nice if you could add more infos to the Wiki, e.g. a formula and explanation of how each metric is calculated.

I will research them for myself now and add a proposal to this issue. If anyone knows a good source please add it here.

FabianHertwig commented 1 year ago

I decided to turn it into a blog post: https://fabianhertwig.com/blog/information-retrieval-metrics/

If you want to pull anything from that to put it into the wiki then feel free to do so.

thakur-nandan commented 1 year ago

Thank you! This is quite informative.

Will update the Wiki Metrics to include portions from the blogpost for each metrics! Credits would be given as well! :)

Kind Regards, Nandan Thakur