Include Vespa Lexical Search as an option to BEIR benchmark

beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.

http://beir.ai

Apache License 2.0

1.55k stars 186 forks source link

Include Vespa Lexical Search as an option to BEIR benchmark #76

Open thigm85 opened 2 years ago

thigm85 commented 2 years ago

@NThakur20 could you take a look at this PR? The idea is to make it easier to benchmark Vespa applications using the BEIR datasets and framework. We started with Lexical Search but will make it more general later.

thakur-nandan commented 2 years ago

Hi @thigm85, thank you for providing this PR!

in the next upcoming days, I will have a look at the PR. I'm happy to see Vespa being included within BEIR!

I was busy shifting the repository last few weeks. Will soon merge with the development branch and later release with the next version of beir updates!

Kind Regards, Nandan Thakur