Open shreyas-shinde opened 1 week ago
FYI: I have actually tried the numbered approach and have seen cost, latency go down because of output token reduction and also found that the eval score of downstream task (QA in my case) went up.
@shreyas-shinde feel free to contribute!
@shreyas-shinde So is the process to:
@homanp
You can check the how to here https://www.reddit.com/r/MachineLearning/comments/17k6iha/d_relevance_extraction_in_rag_pipelines/?share_id=j0imtSJRhwS2Jz9gDYplj&utm_content=2&utm_medium=ios_app&utm_name=ioscss&utm_source=share&utm_term=1