search

art-from-the-machine / Mantella

Mantella is a Skyrim and Fallout 4 mod which allows you to naturally speak to NPCs using Whisper (speech-to-text), LLMs (text generation), and xVASynth / XTTS (text-to-speech).
https://art-from-the-machine.github.io/Mantella/
GNU Affero General Public License v3.0
169 stars 42 forks source link

Updated logging messages for clarity and to specifically address/clar… #353

Closed jonathonbarton closed 1 week ago

jonathonbarton commented 1 month ago

Updated wordsmithing for logging - generally overall, but specifically to address all the frequently asked questions in #issues on the Discord regarding the 4096 token low token count "warning" that is not actually any kind of error, but is just educational and requires no user action.

art-from-the-machine commented 1 week ago

Closing this as the default OpenRouter model has been switched to a 8k token model

jonathonbarton commented 1 week ago

Art - I submitted the PR even after seeing that Mantella is getting the Context Window from the API from OR. It's still useful for users who are running a local LLM...

jonathonbarton commented 1 week ago

image

Even in the current version this is still an issue that this PR addresses.