search

castorini / ragnarok

Retrieval-Augmented Generation battle!
Apache License 2.0
45 stars 3 forks source link

Semantic embedding models retrievers #9

Open olbackuper opened 1 month ago

olbackuper commented 1 month ago

Hi, I just looked into the paper and code briefly and I wonder if currently, BM25 is in fact the only retrieval model that is supported? No semantic models as retrievers functionality is built-in by default?

ronakice commented 1 month ago

Hey! Most models should be supported, it's all about surfacing that as a REST endpoint which the RAGnarok models can access (which we do in the demos) or make sure they are in the standard retrieve results format shared by this codebase and RankLLM). In fact in most cases we end up running generation over reranked results (after several rounds)