feast-dev / feast

The Open Source Feature Store for Machine Learning
https://feast.dev
Apache License 2.0
5.47k stars 977 forks source link

Add support for get_historical_features for vector search #4336

Open franciscojavierarceo opened 2 months ago

franciscojavierarceo commented 2 months ago

Is your feature request related to a problem? Please describe. Currently we only support retrieve_online_documents. We should add a way to allow for vector search for historical retrieval so users could then use Retrieval Augmented Fine Tuning (RAFT) in their training as outlined in this blog post

Describe the solution you'd like A clear and concise description of what you want to happen.

We should figure out how to create a retrieve_offline_documents function that fits within the existing get_historical_features rather than implement something separately...but that may not be trivial.

Describe alternatives you've considered N/A

Additional context https://techcommunity.microsoft.com/t5/ai-ai-platform-blog/raft-a-new-way-to-teach-llms-to-be-better-at-rag/ba-p/4084674?WT_mc_id=aiml-122224-cedricvidal

https://ai.meta.com/blog/raft-llama-retrieval-augmented-generation-supervised-fine-tuning-microsoft/

franciscojavierarceo commented 2 months ago

FYI @HaoXuAI @jeremyary