search

erew123 / alltalk_tts

AllTalk is based on the Coqui TTS engine, similar to the Coqui_tts extension for Text generation webUI, however supports a variety of advanced features, such as a settings page, low VRAM support, DeepSpeed, narrator, model finetuning, custom models, wav file maintenance. It can also be used with 3rd Party software via JSON calls.
GNU Affero General Public License v3.0
1.17k stars 123 forks source link

Some SillyTavern TTS options are ignored #225

Closed bobcate closed 6 months ago

bobcate commented 6 months ago

diagnostics.log

Some checkbox settings in "SillyTavern > Extensions > TTS" are ignored

Steps to reproduce:

  1. Set up SillyTavern and AllTalk to work together
  2. Go to "SillyTavern > Extensions > TTS", enable AllTalk
  3. Check Ignore *text, even "quotes", inside asterisks* or Skip codeblocks
  4. Promt character to respond with the formatting as above
  5. Observe AllTalk as it ignores the checked boxes and still generates voice

Narrator voice is on. Text Not Inside * or " is setting doesn't matter, generates voice on both options. Restarting everything after checking the boxes has no effect.

AllTalk installed, fresh: 14/05/2024 Custom Python environment: Just ran the setup. Using standalone AllTalk.

erew123 commented 6 months ago

Hi @bobcate

image (This is how I have mine configured currently)

These settings actually managed/created by SillyTavern and decide what is or isn't passed to any TTS engine extensions, they are not specifically part of AllTalk.

The only one that is specifically used by AllTalk is "Pass Asterisks to TTS Engine".

For AllTalks narrator to function, it requires text to be sent over to it with with double quotes " for character spoken text, inside asterisks * for narrated portions, then any text that falls outside of those 2 options would be something you can choose with Text Not Inside * or " is

If those other functions are filtering out the double quotes or asterisks, then the AllTalk narrator wont be able to pick out the relevant parts.

Text not inside works in the following way:

image

So this is an example of a working configuration:

image

In later versions of AllTalk I will be adding an option for a silent narrator, but its not available yet.

As for what SillyTaverns other options do/dont strip out, I cannot say. You would have to look in the console F12 and you can see TTS messages there. e.g. here is a TTS message in the console that is sent over AllTalk, As you can see SillyTavern sends it over with asterisks, which will define it as Narrated speech.

image

image

Not sure if that answers your question or not?

Thanks

bobcate commented 6 months ago

Thank you for the detailed explanation. Checking the browser console, regardless of the settings, SillyTavern still passes the kind of texts I mentioned in the first message. I'll report this on SillyTavern's page.

erew123 commented 6 months ago

@bobcate You're welcome to reference this ticket if there is something relevant that they need me to do in AllTalk later down the line and they can respond here.

Thanks