anon998 / simple-proxy-for-tavern

GNU Affero General Public License v3.0
110 stars 6 forks source link

Cannot use in group mode #22

Open arnorex opened 1 year ago

arnorex commented 1 year ago

Hey, is it normal this doesn't work with SillyTavern group mode? Almost every time a character writes something after another character it just sorta freezes and returns the "Could not generate output after 5 attempts" error. It doesn't happen if character is responding after user, only after another character.

model: 'gpt-3.5-turbo', temperature: 0.9, frequency_penalty: 0.7, presence_penalty: 0.7, top_p: 1, max_tokens: 300, stream: false, reverse_proxy: 'http://127.0.0.1:29172/v1', logit_bias: {} } { choices: [ { message: [Object] } ] } { content: '' }