Is your feature request related to a problem? Please describe.
Currently we only support retrieve_online_documents. We should add a way to allow for vector search for historical retrieval so users could then use Retrieval Augmented Fine Tuning (RAFT) in their training as outlined in this blog post
We should figure out how to create a retrieve_offline_documents function that fits within the existing get_historical_features rather than implement something separately...but that may not be trivial.
Is your feature request related to a problem? Please describe. Currently we only support
retrieve_online_documents
. We should add a way to allow for vector search for historical retrieval so users could then use Retrieval Augmented Fine Tuning (RAFT) in their training as outlined in this blog postDescribe the solution you'd like A clear and concise description of what you want to happen.
We should figure out how to create a
retrieve_offline_documents
function that fits within the existingget_historical_features
rather than implement something separately...but that may not be trivial.Describe alternatives you've considered N/A
Additional context https://techcommunity.microsoft.com/t5/ai-ai-platform-blog/raft-a-new-way-to-teach-llms-to-be-better-at-rag/ba-p/4084674?WT_mc_id=aiml-122224-cedricvidal
https://ai.meta.com/blog/raft-llama-retrieval-augmented-generation-supervised-fine-tuning-microsoft/