search

wsippel / bark_tts

Oobabooga extension for Bark TTS
GNU Affero General Public License v3.0
110 stars 14 forks source link

One word at a time.... #7

Closed OrphBean closed 1 year ago

OrphBean commented 1 year ago

My install seems to regenerate the whole sequence at every new word. Anyone have a fix?

So it'll output "So So how So how are So how are you" etc etc

I am running the default install on Win 11, with a 4090

wsippel commented 1 year ago

I've seen this happen randomly, but haven't found a way to reliably reproduce it, which makes it quite difficult to debug. It doesn't even make sense to me to begin with, as my tokenizer never splits by word, only by sentence.

EDIT: Just noticed you posted the same issue on Reddit and got what appears to be a good explanation. The extension should force no-stream by itself when TTS is on. If it doesn't, that's absolutely a bug. I'll take a look.

qingtom commented 1 year ago

same issue. the plugin regenerate the whole sentence every time a token is generated, which make the conversation very slow.

any solution to this?

I have config the tokenize = False, which I guess to config the action.

wsippel commented 1 year ago

The extension should properly disable streaming now. Feel free to reopen the issue if it somehow doesn't.