search

okisdev / ChatChat

Chat Chat, your own unified chat and search to AI platform, with a simple and easy to use interface.
https://chat.okisdev.com
GNU Affero General Public License v3.0
1.17k stars 215 forks source link

Possible to add the support for vector DB/Embedding #59

Open xubairp opened 1 year ago

xubairp commented 1 year ago

Hi,

I tried testing some PDF file, but when i wanted to query/ask it give error that the context window limit is reached, so i believe you are adding the whole content of the file into the prompt, i can see that this will be helpful with the Claude 100K context window, but for the Chatgpt 4 at the moment this is limitation.

Is it possible to add support for the vector DB such as Supabase which will store the embedding and then it will be queried to retrieve the most relevant chunk(s) based on the user query.

okisdev commented 1 year ago

Hi. Thanks for your feedback.

This feature is on board (https://github.com/users/okisdev/projects/7?pane=issue&itemId=27332102), it might be delivered as a separate project, focusing on large file(s)/contexts handling.