search

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.55k stars 186 forks source link

Missing datasets #61

Closed thigm85 closed 2 years ago

thigm85 commented 2 years ago

Hi, it seems that some datasets that are on the leaderboard are missing from https://public.ukp.informatik.tu-darmstadt.de/thakur/BEIR/datasets/

For example:

Is there a reason for removing those datasets?

thakur-nandan commented 2 years ago

Hi @thigm85,

I do not have permissions to freely open-source and provide these datasets due their individual licence policies. You can check on how to replicate them yourself from the README file here: https://github.com/UKPLab/beir/tree/main/examples/dataset.

Kind regards, Nandan

thigm85 commented 2 years ago

Thanks for the quick response. I got it :)