Semantic caching for RAG based chatbots

aws-samples / genai-quickstart-pocs

This repository contains sample code demonstrating various use cases leveraging Amazon Bedrock and Generative AI. Each sample is a separate project with its own directory, and includes a basic Streamlit frontend to help users quickly set up a proof of concept.

MIT No Attribution

307 stars 102 forks source link

Semantic caching for RAG based chatbots #303

Closed awsrk closed 1 month ago

awsrk commented 5 months ago

Customers are looking for easy ways to cache similar questions/responses in their RAG systems. I'm looking to build a step functions based workflow which incorporates semantic caching utilizing opensearch and a postgressql database

awsrk commented 5 months ago

I will work on this POC. ETA 2 weeks.

ryanadoty commented 4 months ago

That sounds great! Any updates you can provide here would be great!

flamingquaks commented 1 month ago

This appears completed with the merge of #320. Closing Issue