search

mmz-001 / knowledge_gpt

Accurate answers and instant citations for your documents.
https://knowledgegpt.streamlit.app/
MIT License
1.58k stars 729 forks source link

Any way for the uploaded text can storre permanently? #4

Open vst212 opened 1 year ago

vst212 commented 1 year ago

I wonder is it any way that can store for permanently, no need uploade when refreshed.

mmz-001 commented 1 year ago

Thanks for reaching out! I exploring options for permanent data storage and it's definitely on my radar. Stay tuned for updates in the future.

vst212 commented 1 year ago

I found that it may be the most urgent issue as the costing is so high in duplication of upload the docunment. I just see the costing and omg ~~

Klaudioz commented 1 year ago

Technically, what is the reason that the documents are not stored permanently?

mmz-001 commented 1 year ago

Technically, what is the reason that the documents are not stored permanently?

All the documents are stored in memory right now and are deleted once you close the tab. I'm currently working on a solution for permanent data storage.

Klaudioz commented 1 year ago

Can be done using a embedding database like Chroma?

Klaudioz commented 1 year ago

Or Pinecone.

I want to contribute, but I'd like more information about it to start researching.

jwaltz commented 1 year ago

@mmz-001 thank you for the excellent work on this project.

Any update on persisting documents?

edan-shalom commented 1 year ago

@mmz-001 Is there a branch you are working on that permanent storage solution? I would very much like to contribute.