exoascension / vault-chat

A ChatGPT bot trained on your vault notes. Ask your AI questions about your own thoughts and ideas!
GNU General Public License v3.0
113 stars 7 forks source link

It can't answer my question #11

Open Liong1976 opened 1 year ago

Liong1976 commented 1 year ago

Here is what I got from this plugin.

image

And this is a screenshot from my console.

image

I am on Windows.

kristenbrann commented 1 year ago

Thanks for letting us know, @Liong1976! I think there are a few things that could be happening here.

One is the prompt engineering... under the hood we tell ChatGPT about your notes in system messages to give it context for the conversation. It can be tricky to get the best wording to set up ChatGPT for success. It would help me to understand what kind of text you have in your vault that would indicate to ChatGPT what your hobbies are? Do you have any files that explicitly refer to hobbies? Do you believe the hobbies should be able to be inferred based on other types of content? Whatever you are willing to share here will help us best understand and optimize the way we communicate with the API.

The other is that there could be an error. Based on your screenshot, I see one rate limiting error. The other messages in red are actually warnings. In order for ChatGPT to have the info it needs to answer your question, we first use embeddings to search your notes for relevant files. Then we pass the files resulting from that as context to the chat API. If the call to embeddings fails, then ChatGPT has no context from your files when we ask it your question. We are going to add some more logging and error handling for this scenario to better identify it. Without explicitly debugging, I can't be sure if this happened in your case.

Liong1976 commented 1 year ago

Hi @kristenbrann,

Thanks for your prompt response.

Most of my notes are related to research on historical studies. On the other hand, my personal notes were written in my native language, which is a non-English language. I just replicated what you showed in the plugin's description to know if this plugin works.

As for the console, I saw a lot of red messages, but I didn't screenshot them, for they contained the data from my vault.

cpaika commented 1 year ago

Ok, we've released block embeddings so we're indexing your notes in chunks instead of as one giant glob. This should have increased the accuracy of your results by a lot. Does it seem like it's working better now if you update? It's tough judging accuracy, it's a bit qualitative.

Liong1976 commented 1 year ago

Thanks for the update.

When I use this plugin, will my data be uploaded to the OpenAI cloud? I don't want my data to be uploaded, for it has sensitive content, such as my passwords.

cpaika commented 1 year ago

Yes it will, until we have locally trained models we need to do this. You can add an exclusion path in the plugin settings to exclude directories with sensitive content.

OpenAI's data usage policy can seen here: https://openai.com/policies/api-data-usage-policies

Liong1976 commented 1 year ago

Thanks for the explanation.

I tried to reinstall the plugin, but it didn't work.

image

cpaika commented 1 year ago

@Liong1976 Ah sorry about that, fixed the release should work now thanks for raising the problem

Liong1976 commented 1 year ago

Hi @cpaika,

Now the plugin works very well. Thank you so much!

Does it upload the data to the OpenAI cloud every time I start Obsidian, or does it just add the new data?