issues
search
beir-cellar
/
beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.55k
stars
186
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Unable to create Index in Elastic Search
#34
pritamdeka
closed
3 years ago
1
a question about how to use BM25 in evaluate_custom_dataset.
#33
Graduo
closed
3 years ago
7
Custom multilingual issues
#32
Graduo
closed
3 years ago
0
Merging latest development branch to main branch
#31
thakur-nandan
closed
3 years ago
0
The QRel file rank for BioASQ
#30
ari9dam
opened
3 years ago
1
Fix typo in `evaluate_ance.py`
#29
JetRunner
closed
3 years ago
1
Allows generating doc2query-T5 queries in parallel
#28
joshdevins
closed
3 years ago
2
DPR on MSMARCO
#27
JetRunner
closed
3 years ago
2
Merge Development into main branch
#26
thakur-nandan
closed
3 years ago
0
chg: title optional
#25
svakulenk0
closed
3 years ago
2
Training ColBERT on a new test collection
#24
shashankg7
closed
3 years ago
1
Processing CQADupstack does not work out-of-the-box
#23
joshdevins
closed
3 years ago
1
Add GermanQuAD dataset
#22
julian-risch
closed
3 years ago
1
Allow GPU parallelization to take advantage of multi-GPU instances
#21
joshdevins
closed
3 years ago
6
Separate average score for zero-shot only
#20
joshdevins
closed
3 years ago
3
Add BM25+RM3 as a baseline to re-ranking leaderboard
#19
joshdevins
closed
3 years ago
2
Merging latest master to development
#18
thakur-nandan
closed
3 years ago
0
init_weights error when loading DPR models from HF modelhub
#17
Timoeller
closed
3 years ago
2
Unable to find pyserini docker
#16
cadurosar
closed
3 years ago
1
Storing document embeddings index
#15
svakulenk0
closed
3 years ago
7
Question about ArguAna dataset - same content for the `text` field of queries.jsonl and corpus.jsonl
#14
nijianmo
closed
3 years ago
4
Robust04 preprocessing
#13
ji-xin
closed
3 years ago
4
Error loading model in `query_gen_and_train.py`
#12
Yu-Shi
opened
3 years ago
1
webis-touche2020 qrels
#11
seanmacavaney
opened
3 years ago
5
Include enriched sparse lexical retrieval methods
#10
joshdevins
opened
3 years ago
10
CQAdupstack evaluation
#9
cadurosar
closed
3 years ago
3
Low BM25 baselines?
#8
lintool
opened
3 years ago
0
Datasets without Download Links
#7
sclincha
closed
3 years ago
2
Reranking with custom SentenceTransformer model issue - SentenceTransforme' object has no attribute 'encode_queries'Hi,
#6
corticalstack
closed
3 years ago
4
Syntax issue in retrieval evaluate_custom_model.py
#5
corticalstack
closed
3 years ago
1
Elastic Search Connection Error
#4
ji-xin
closed
3 years ago
5
Adding TREC ad-hoc collections
#3
thibault-formal
closed
3 years ago
4
Is it reasonable to add other models to construct QFilter except CrossEncoder And can QGenModel will help to improve with real query ?
#2
svjack
closed
3 years ago
14
Dose this framework support function to make a summary about model performance on different datasets or single dataset in different model performance and support dynamic benchmark ?
#1
svjack
closed
3 years ago
11
Previous