This adds a parameter to cleanUpMessage() which determines whether the user_prompt_bias will be prepended to the passed text. It is true by default to avoid disrupting current usage. Additionally, this parameter is set to false when used in generateRaw(), as the user_prompt_bias is explicitly not used in that function.
Motivation
This fixes a bug where the user_prompt_bias was incorrectly being prepended to generations when using generateRaw() even though it wasn't being added to the prompt. Bug was demonstrated in this discord message and the solution discussed in this one.
Description
This adds a parameter to
cleanUpMessage()
which determines whether theuser_prompt_bias
will be prepended to the passed text. It is true by default to avoid disrupting current usage. Additionally, this parameter is set tofalse
when used ingenerateRaw()
, as theuser_prompt_bias
is explicitly not used in that function.Motivation
This fixes a bug where the
user_prompt_bias
was incorrectly being prepended to generations when usinggenerateRaw()
even though it wasn't being added to the prompt. Bug was demonstrated in this discord message and the solution discussed in this one.Checklist: