naver / splade

SPLADE: sparse neural search (SIGIR21, SIGIR22)
Other
737 stars 80 forks source link

Benchmark Performance After Re-ranking? #8

Closed mattare2 closed 2 years ago

mattare2 commented 2 years ago

I'm curious if you've run your model with a "second-stage" reranker, on the BEIR benchmarks. Would you expect much benefit from this?

Thank you, and excellent work!

thibault-formal commented 2 years ago

Hi @mattare2 , We did not try to use a re-ranker on top of SPLADE on BEIR. I am guessing we would observe some benefit (similarly to BM25 + CE re-ranker > BM25), but it's definitively something we should try !

Best, Thibault