mukulpatnaik / researchgpt

A LLM based research assistant that allows you to have a conversation with a research paper
https://www.dara.chat
MIT License
3.55k stars 340 forks source link

Save embeddings #5

Closed pakaca closed 1 year ago

pakaca commented 1 year ago

Hello, thanks for this!

Should this also work well for longer texts like books? And if so, can it easily be made to cache the embeddings to disk? I'm assuming it's not that cheap nor fast to do that every time if it's a long thing, right?

mukulpatnaik commented 1 year ago

Hi @pakaca , I have added a way to store embeddings locally using redis. You can find that implementation here. You have to install redis and run redis-serve in a separate terminal for this to work