SillyTavern / SillyTavern

LLM Frontend for Power Users.
https://sillytavern.app
GNU Affero General Public License v3.0
13.77k stars 3.14k forks source link

Fixing user_prompt_bias being incorrectly added using generateRaw() #3711

Closed qvink closed 1 month ago

qvink commented 1 month ago

Description

This adds a parameter to cleanUpMessage() which determines whether the user_prompt_bias will be prepended to the passed text. It is true by default to avoid disrupting current usage. Additionally, this parameter is set to false when used in generateRaw(), as the user_prompt_bias is explicitly not used in that function.

Motivation

This fixes a bug where the user_prompt_bias was incorrectly being prepended to generations when using generateRaw() even though it wasn't being added to the prompt. Bug was demonstrated in this discord message and the solution discussed in this one.

Checklist: