Optimize Retrieval Mechanism for RAG Model

[Vikranth3140]

Description:

The current retrieval mechanism may not be optimized for speed and relevance, potentially leading to slower responses and less accurate results. Implementing more efficient retrieval algorithms or indexing methods can improve this.

Tasks:

1. Implement a more efficient indexing method like FAISS.
2. Optimize the retrieval queries for better relevance.
3. Profile and benchmark the performance improvements.

[AryaChakraborty]

The retrieval mechanism is optimized. There are options like :

• Normal retrievers
• re rankers
• hybrid retrievers
• evaluation retrievers These are plenty for solving mostly every usecase