Mantella is a Skyrim and Fallout 4 mod which allows you to naturally speak to NPCs using Whisper (speech-to-text), LLMs (text generation), and xVASynth / XTTS (text-to-speech).
It can often be confusing why conversations are reloaded frequently for LLMs with small token limits. Displaying the number of tokens used in the starting prompt (which includes the NPC's bio and memories) can help give an idea as to how much space the LLM has for a conversation before needing to reload.
art-from-the-machine
commented
4 months ago
It can often be confusing why conversations are reloaded frequently for LLMs with small token limits. Displaying the number of tokens used in the starting prompt (which includes the NPC's bio and memories) can help give an idea as to how much space the LLM has for a conversation before needing to reload.