search

josephrocca / OpenCharacters

Simple little web interface for creating characters and chatting with them. It's basically a single HTML file - no server. Share characters using a link (character data is stored within the URL itself). All chat data is stored in your browser using IndexedDB. Currently supports OpenAI APIs and ~any Hugging Face model.
https://josephrocca.github.io/OpenCharacters
MIT License
375 stars 64 forks source link

Issue with DaVinci: responses getting cut off. #7

Closed RichWolfmann closed 1 year ago

RichWolfmann commented 1 year ago

I have been experiencing trouble while trying to use DaVinci. GPT works just fine, but whenever I switch to DaVinci, the completion shows up as incomplete, cut off. I'm suspecting it has something to do with max_tokens. I think adding more ways to tinker with the character, such as max_tokens, top P, top K or rep penalty would be quite good. What should I do to fix this in the meantime?

josephrocca commented 1 year ago

Thanks! This should be fixed now - please test and let me know if you're still running into this problem or any others.

I'll definitely be adding the ability to customize other params - tracking that here: https://github.com/josephrocca/OpenCharacters/issues/5

RichWolfmann commented 1 year ago

Thanks! This should be fixed now - please test and let me know if you're still running into this problem or any others.

I'll definitely be adding the ability to customize other params - tracking that here: #5

Thanks for the reply! Unfortunately I'm still running into the issue, maybe it's a problem on my end? A few days ago I was able to use DaVinci just fine but now I simply can't.

josephrocca commented 1 year ago

Hmm. Can you try clicking your browser refresh button a few times consecutively to trigger a cache clear? If it's still an issue, would you be able to post some screenshots and/or message sequence examples?

josephrocca commented 1 year ago

Actually I'm still seeing problems here myself sometimes... investigating.

Let me know if you're still getting the same problem (and if frequency of occurrence has changed at all)

RichWolfmann commented 1 year ago

Sorry for the long delay, I've been busy. But the problem is fixed! I mus admit though, GPT is somehow better than DaVinci a lot of the time, way more customizable, so I'll stick to it.