Open notfood opened 1 year ago
Thanks! I'll add these as character settings for sure
It's now possible to chance presence penalty, frequency penalty, and other stuff, but not yet max_tokens. You gotta do it via custom code for now though. Quoting the custom code documentation:
Note that currently only the temperature
setting is available in the character editor, so if you e.g. wanted to add a stop sequence for your character so it stops whenever it writes ":)" and also set presence pentalty to 1, then you could do it by adding this text to the custom code text box in the character editor:
oc.character.stopSequences = [":)"];
oc.character.presencePenalty = 1;
The
frequency_penalty
,presence_penalty
,max_tokens
are useful to tinker with the responses further, should be per character to allow maximum flexibility. Context limit would be how many tokens at most must be sent at max instead of using the limit of 4096, setting it at half helps to save on $$$ at the cost of some memory.