josephrocca / OpenCharacters

Simple little web interface for creating characters and chatting with them. It's basically a single HTML file - no server. Share characters using a link (character data is stored within the URL itself). All chat data is stored in your browser using IndexedDB. Currently supports OpenAI APIs and ~any Hugging Face model.
https://josephrocca.github.io/OpenCharacters
MIT License
364 stars 60 forks source link

Local LLM resulting in no output #71

Open Seantourage opened 7 months ago

Seantourage commented 7 months ago

Attempting to link this to a LLM. It connects, send the prompt and the local LLM properly parses and responds however the character output remains blank.

I've tried using: kobold.cpp and oobabooga text-generation Both with the custom model config and the optional proxy script

Regardless I get the same issue no matter the combination. Any ideas?