issues
search
beir-cellar
/
beir
A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.49k
stars
177
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Allow "show_progress_bar" and "convert_to_tensor" in `DenseRetrievalExactSearch`
#127
xhluca
closed
12 months ago
1
MonoT5 .predict gives NaN
#126
maxmatical
opened
1 year ago
2
Use invoked logger and not logging library
#125
ugm2
closed
12 months ago
1
Proposal: Describe metrics in Wiki with more details
#124
FabianHertwig
opened
1 year ago
2
supporting chinese dataset retrieval?
#123
yajingsunno
opened
1 year ago
3
Training script/configuration for DocT5query
#122
jihyukkim-nlp
opened
1 year ago
0
Quora titles are empty on Huggingface
#121
jxmorris12
closed
1 year ago
2
Add file for using custom sbert model with BEIR
#120
Agrover112
opened
1 year ago
0
Add example notebook for benchmarking BEIR using an Sentence Transformer(SBERT) Custom Model
#119
Agrover112
opened
1 year ago
1
fix: typing issue raising warnings in mypy and pylance
#118
qherreros
opened
1 year ago
3
Fix bug of retrieving more docs than specified: Use heapq to maintain top-K
#117
kwang2049
closed
12 months ago
7
Support for revisions in HFDataLoader
#116
Muennighoff
opened
1 year ago
0
Check tf dependencies completely
#115
kwang2049
closed
12 months ago
0
HFDataLoader is incompatible with CQADupstack
#114
Muennighoff
opened
1 year ago
0
ModuleNotFoundError
#113
haha978
closed
1 year ago
0
New Dataset inclusion to BEIR benchmarks
#112
naveenjafer
opened
1 year ago
0
the number of queries is not as reported for some datasets?
#111
lmh0921
closed
1 year ago
2
Different version of marco training set
#110
jzhoubu
closed
1 year ago
1
DenseRetrievalExactSearch: Out of memory
#109
memray
opened
1 year ago
1
NQ training qrels missing
#108
cadurosar
closed
1 year ago
2
fix cos_scores_top_k_idx when using DRPES
#107
NouamaneTazi
closed
1 year ago
0
Is re_ranking implementation wrong?
#106
wasiahmad
opened
1 year ago
5
Custom metrics handle document score ties differently from pytrec_eval
#105
obelhumeur
opened
1 year ago
0
Different results using DenseRetrievalExactSearch & DenseRetrievalParallelExactSearch
#104
Muennighoff
opened
1 year ago
10
Does BEIR support tuning config k and b of BM25 ?
#103
Yuan0320
opened
2 years ago
2
custom metric implementation depend on length of qrels
#102
iknoorjobs
closed
1 year ago
2
Inconsistency in Arguana
#101
claeyzre
opened
2 years ago
0
DPR [KILT] checkpoint release plan and which data is used?
#100
hanseokOh
opened
2 years ago
0
Re-using same GenericDataLoader for different splits raises KeyError
#99
j-rossi-nl
opened
2 years ago
0
Merge all latest development changes to master
#98
thakur-nandan
closed
2 years ago
0
Parallel computation fixes
#97
NouamaneTazi
closed
2 years ago
0
Fix type annotation
#96
jordane95
closed
2 years ago
1
the number of queries in MSMARCO
#95
mjeensung
closed
2 years ago
2
Thoughts on reorganizing BEIR main landing page
#94
lintool
closed
2 years ago
2
`java.lang.OutOfMemoryError: Java heap space` error when running docker
#93
ichbinhandsome
closed
2 years ago
1
Add Manticore Search to the BEIR benchmarks
#92
Nick-S-2018
opened
2 years ago
0
add option ignore_identical_ids in evaluation, important for Pyserini (+CE) on ArguAna
#91
kwang2049
closed
2 years ago
0
Support multi-gpu training?
#90
jordane95
closed
2 years ago
6
Difference between SBERT and DPR?
#89
jordane95
closed
2 years ago
2
url to msmarco triples do not exists anymore
#88
jordane95
closed
2 years ago
1
Reproducing msmarco-MiniLM-L-6-v3 results
#87
matprst
closed
2 years ago
2
Pre-processing code for missing datasets
#86
memray
closed
2 years ago
6
Introduce `RetrievalModel` abstract base class
#85
tstadel
closed
12 months ago
2
Support for custom retrievers: common base type for `EvaluateRetrieval`'s `retriever` param
#84
tstadel
opened
2 years ago
3
Merging Development into master
#83
thakur-nandan
closed
2 years ago
0
Marco triplet in train_msmarco_v2.py
#82
WenzhengZhang
closed
2 years ago
2
The number of queries for Robust04 seems to be 250 instead of 249
#81
kwang2049
closed
2 years ago
2
Question about MS MARCO dataset in BEIR
#80
jordane95
closed
2 years ago
2
Elasticsearch connection error for BM25
#79
jaxball
closed
2 years ago
1
Title needed when using retriever.retrieve after using GenericDataLoader(...)load_custom(...)
#78
obelhumeur
opened
2 years ago
1
Previous
Next