superlinear-ai / raglite

🥤 RAGLite is a Python toolkit for Retrieval-Augmented Generation (RAG) with PostgreSQL or SQLite
Mozilla Public License 2.0
71 stars 2 forks source link

Specify search method #37

Open emilradix opened 1 month ago

emilradix commented 1 month ago

Right now you have to specify whether you use hybrid, vector or keyword search in the answer_evals and rag method. If unspecified it defaults to hybrid_search.

I think this approach could lead to people accidentally mismatching their search methods, for example if they forget to specify it in answer_evals, but do in the rag method.

I think we should either force the user to always specify the search method, or have them set the default search method in the RagLiteConfig.