pashpashpash / vault-ai

OP Vault ChatGPT: Give ChatGPT long-term memory using the OP Stack (OpenAI + Pinecone Vector Database). Upload your own custom knowledge base files (PDF, txt, epub, etc) using a simple React frontend.
https://vault.pash.city
MIT License
3.26k stars 307 forks source link

Feature Request: Use Chroma instead of Pinecone #6

Open bjorkmeister opened 1 year ago

bjorkmeister commented 1 year ago

Rationale: I would like to set this up locally and Pinecone only has a paid subscription model, if you are not whitelisted through the waiting list.

I would like to set this up using a local running version of Chroma.

Armadillidiid commented 1 year ago

Weaviate would be nice too. It's free and open source

bradfair commented 1 year ago

+1 for abstraction at the storage layer; I'd like to use Milvus.

Bergdoktor commented 1 year ago

+1 Don't know which service I'd use but since pinecone is basically paid only for the time being, I'd love to use "anything else". Don't mind setting it up myself.

Jasmin25 commented 1 year ago

+1 Don't know which service I'd use but since pinecone is basically paid only for the time being, I'd love to use "anything else". Don't mind setting it up myself.

+1

isConic commented 1 year ago

Pinecone has a free-tier that works for Vault-ai. People can use it without paying.

Bergdoktor commented 1 year ago

Yeah, but there's a waiting list for the free tier. I actually just got in yesterday after waiting for about 5 days.

isConic @.***> schrieb am Fr., 21. Apr. 2023, 03:25:

Pinecone has a free-tier that works for Vault-ai. People can use it without paying.

— Reply to this email directly, view it on GitHub https://github.com/pashpashpash/vault-ai/issues/6#issuecomment-1517128087, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEV5MCNC3KK4MH5MMRISTRLXCHOZRANCNFSM6AAAAAAXC4JAQM . You are receiving this because you are subscribed to this thread.Message ID: @.***>

botheredbybees commented 1 year ago

I'd like to run this against our technical and scientific documentation on a blue water research vessel with limited internet bandwidth, so the 'anything else' option would good to see.

barretto94 commented 1 year ago

Pinecone has a free-tier that works for Vault-ai. People can use it without paying.

I'm not too keen on the user agreement where you: Grant Pinecone and its suppliers a non-exclusive, royalty-free license to access, use, reproduce, modify and display the Customer Data for the purposes of (i) providing the Hosted Services, (ii) exercising its rights and obligations under this Agreement; (iii) generating Aggregated and Anonymous Data (as defined below).... Customer further agrees that Pinecone shall own such Aggregated and Anonymous Data and may retain, use and disclose such data for any lawful business purpose, including to improve its products and services.

For proof of concept that's okay, but with sensitive data, I rather host that in-house, a secured data center, or cloud host.

zakariaelh commented 1 year ago

same here, I don't see a reason to host in pinecone when running it locally. Also Pinecone charges by time of use (no by how many times you access the data) and it's very expensive.