search

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.62k stars 192 forks source link

[Question] Using T5 as a retriveal model in BeIR #139

Open rahmanidashti opened 1 year ago

rahmanidashti commented 1 year ago

Hi there,

Is there any way or approach to use the T5 model as a retrieval model in BeIR?

thakur-nandan commented 1 year ago

@rahmanidashti,

Do you have any specific T5 retrieval model you wish to use? Are the model weights publicly available on Huggingface?

Thanks, Nandan

rahmanidashti commented 1 year ago

@thakur-nandan

Thanks, Nandan! No, I do not have any specific model in mind, can we use the same T5 model that we use to generate the synthetic queries for the ranking? Can we use it to estimate the joint probability of passage and query?

Thanks, Saeed