issues
search
beir-cellar
/
beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.54k
stars
182
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
The number of queries for Robust04 seems to be 250 instead of 249
#81
kwang2049
closed
2 years ago
2
Question about MS MARCO dataset in BEIR
#80
jordane95
closed
2 years ago
2
Elasticsearch connection error for BM25
#79
jaxball
closed
2 years ago
1
Title needed when using retriever.retrieve after using GenericDataLoader(...)load_custom(...)
#78
obelhumeur
opened
2 years ago
1
How did you evaluate ColBERT on BEIR benchmark?
#77
jordane95
closed
2 years ago
1
Include Vespa Lexical Search as an option to BEIR benchmark
#76
thigm85
opened
2 years ago
1
Question about details/scripts for generating the datasets
#75
narayanacharya6
closed
2 years ago
4
Strange NDCG@10 for Touche-2020 on the BEIR leaderboard
#74
thigm85
opened
2 years ago
6
End-Task Labels
#73
anthonywchen
closed
2 years ago
2
Why index the queries together with the corpus?
#72
thigm85
closed
2 years ago
2
On the dependency `faiss`
#71
jordane95
opened
2 years ago
1
Eval script breaks for custom evaluations when query does not have any hits
#70
narayanacharya6
closed
2 years ago
1
Question on the BM25 implementation
#69
jordane95
closed
2 years ago
0
Training configuration for ColBERT
#68
jihyukkim-nlp
closed
2 years ago
5
Evaluation codes for ColBERT
#67
rainatam
opened
2 years ago
11
TypeError when running Quick Example
#66
ReyonRen
opened
2 years ago
1
Script to generate leaderboard metrics
#65
thigm85
closed
2 years ago
3
ValueError when running `evaluate_bm25.py`
#64
jordane95
opened
2 years ago
5
Sparse query vector
#63
maximedb
opened
2 years ago
5
Fix sparse search
#62
maximedb
closed
2 years ago
1
Missing datasets
#61
thigm85
closed
2 years ago
2
Error in `beir/beir/retrieval/search/sparse/sparse_search.py`
#60
jin530
opened
2 years ago
1
Question about ideal architecture for deep IR
#59
pablogranolabar
opened
2 years ago
0
Unsupported Elastic Search distribution on BEIR.ipynb
#58
thigm85
opened
2 years ago
5
No Quora & CQADupstack in leaderboard?
#57
Muennighoff
opened
2 years ago
2
Providing BM25 top-100 for all datasets
#56
davidmrau
closed
2 years ago
1
250 queries for Robust04?
#55
Muennighoff
closed
2 years ago
0
Rerank scores lower than vanilla dense IR?
#54
pablogranolabar
opened
2 years ago
8
BaseException with rerank - 'dict' object has no attribute 'strip'
#53
pablogranolabar
closed
2 years ago
0
Another metric with the same name already exists.
#52
pritamdeka
closed
2 years ago
2
Training a T5 model
#51
pritamdeka
opened
2 years ago
3
Leaderboard results of USE
#50
ikuyamada
closed
2 years ago
4
UnsupportedProductError: The client noticed that the server is not a supported distribution of Elasticsearch
#49
Muennighoff
closed
2 years ago
0
Merging latest main branch to development
#48
thakur-nandan
closed
2 years ago
0
create qrel.tsv file
#47
xiangpku
closed
2 years ago
2
Fixed how to start Anserini docker and HTTPS request error
#46
ArthurCamara
opened
2 years ago
0
Error in accuracy function
#45
wolhandlerdeb
closed
2 years ago
1
Update evaluate_anserini_docT5query.py
#44
nreimers
closed
2 years ago
1
How to evaluate on Trec-Covid
#43
luomancs
closed
2 years ago
4
Updated webis-touche2020 qrels in website
#42
thakur-nandan
closed
2 years ago
0
Merge latest changes in development
#41
thakur-nandan
closed
2 years ago
0
About webis-touche2020 qrels
#40
guoday
closed
2 years ago
4
add: multilingual datasets mr.tydi and mmarco and msmarco-v2
#39
thakur-nandan
closed
2 years ago
0
Additional annotations for Trec-covid
#38
ji-xin
closed
3 years ago
2
Can't understand a certain line
#37
ji-xin
closed
3 years ago
2
Training data for NQ?
#36
ReyonRen
opened
3 years ago
6
Merge development to master
#35
thakur-nandan
closed
3 years ago
0
Unable to create Index in Elastic Search
#34
pritamdeka
closed
3 years ago
1
a question about how to use BM25 in evaluate_custom_dataset.
#33
Graduo
closed
3 years ago
7
Custom multilingual issues
#32
Graduo
closed
3 years ago
0
Previous
Next