longer context with gtp3.5 16k model gets stuck

brianpetro / obsidian-smart-connections

Chat with your notes & see links to related content with AI embeddings. Use local models or 100+ via APIs like Claude, Gemini, ChatGPT & Llama 3

https://smartconnections.app

GNU General Public License v3.0

2.49k stars 170 forks source link

longer context with gtp3.5 16k model gets stuck #270

Closed avataraustin closed 2 months ago

avataraustin commented 1 year ago

When using the chat and the gpt 3.5 16k model if I ask a question making use of a fairly long context I get the "..." indication that the app is processing but it never returns a result. If I ask a short question with short context, I get an answer back. I tried the same context+question with the Obsidian TextGenerator ChatGPT plugin and I get an answer, so It does not seem to be an OpenAi issue but rather an issue with Smart Connections.

kathekon commented 1 year ago

I also experienced this behavior

brianpetro commented 1 year ago

@avataraustin @kathekon can you check the developer console for errors next time this happens?

If possible, a screenshot of the errors helps a lot.

It will help me track down the source of the bug.

Thanks for reporting this! Brian 🌴