Saved answers for similar queries

mmz-001 / knowledge_gpt

Accurate answers and instant citations for your documents.

https://knowledgegpt.streamlit.app/

MIT License

1.58k stars 729 forks source link

Saved answers for similar queries #7

Open selmanays opened 1 year ago

selmanays commented 1 year ago

What if GPT records the responses in a database and pulls the response from the database instead of sending new requests to OpenAI for similar queries?

mmz-001 commented 1 year ago

All the queries (in the session) are cached with Streamlit so the exact same queries are not run twice. But doing that for similar queries is quite hard because we can't exactly define what "similar queries" mean. Two questions may look quite similar but the answers may be completely different.

blackwhites commented 1 year ago

you can use gptcache