search

ztjhz / BetterChatGPT

An amazing UI for OpenAI's ChatGPT (Website + Windows + MacOS + Linux)
http://bettergpt.chat/
Creative Commons Zero v1.0 Universal
8.05k stars 2.72k forks source link

Title generation takes the full message, which could exceed GPT 3.5 prompt window #508

Open SteveLTN opened 9 months ago

SteveLTN commented 9 months ago

I was having some long conversations with GPT-4-turbo, which has an 128K message window.

Then I received the error message saying the input is too long. After some debugging, I found it's the title generation that always uses GPT 3.5 (which is great!) and full input message.

I guess for the purpose of generating the title, simply truncating the input would be enough :-)

endolith commented 9 months ago

Duplicate of https://github.com/ztjhz/BetterChatGPT/issues/377

Frustrating that this hasn't been fixed