beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.54k stars 182 forks source link

Thoughts on reorganizing BEIR main landing page #94

Closed lintool closed 2 years ago

lintool commented 2 years ago

tl;dr - IMO the current README landing page tries to do too much... I think we should trim down.

For example, why do we have these?

People come to the page for the dataset itself? So these should come first:

All the examples and baselines should come later?

Thoughts @NThakur20 ?

thakur-nandan commented 2 years ago

Hi @lintool,

Sounds good to me. I think we can reposition the quick example and available datasets on top and push course material and multilingual datasets further down on the landing page.

I kept the course material on the IR page, in case someone is not familiar with retrieval or dense retrieval, they can refer to these course materials available online. Similarly, BEIR can also support the evaluation of multilingual datasets, that's why we have a multilingual datasets section.

What do you think @nreimers?

Kind Regards, Nandan Thakur

thakur-nandan commented 2 years ago

The README has been organized accordingly in the latest BEIR version v1.0.1. I am closing the issue.

Kind Regards, Nandan Thakur