beir-cellar / beir

A Heterogeneous Benchmark for Information Retrieval. Easy to use, evaluate your models across 15+ diverse IR datasets.
http://beir.ai
Apache License 2.0
1.5k stars 177 forks source link

Add example notebook for benchmarking BEIR using an Sentence Transformer(SBERT) Custom Model #119

Open Agrover112 opened 1 year ago

Agrover112 commented 1 year ago

Sentence Transformers is one of the easiest libraries to train models for STS/other tasks.Given the fact that people would consequently use SBERT with BEIR given the authors involvement in both it would be natural to look for an example implementation as to how to use them together for benchmarking.

Agrover112 commented 1 year ago

@nreimers