search

MycroftAI / mimic3

A fast local neural text to speech engine for Mycroft
GNU Affero General Public License v3.0
1.04k stars 96 forks source link

Mispronounciation of Finnish TTS sample #4

Open huuhaa opened 2 years ago

huuhaa commented 2 years ago

Describe the bug At Finnish TTS sample there are some mispronuncations, basicle some words are pronoounced with missig last letter.

To Reproduce Steps to reproduce the behavior:

  1. Go to 'https://mycroft.ai/mimic-3/'
  2. Select 'Suomi (Finnish)' on "Hear My Voices
  3. Click 'Play' to hear TTS
  4. Hear error 'missing ending letter for some words'

Expected behavior Expected behavior would be to pronounce whole word, including last letters. Some words to mention.Word ilmiö is pronounced as ilmi. Word etupinnasta is pronounced as etupinnast (first time word appears at sentence, that last a is pronounced as supposed to, but missing when word appears second time. Word sateenkaaren at the end, is also pronounced bit like full or half cutted n at end, sounding like sateenkaare

Log files If possible, add log files from /var/log/mycroft/ to help explain your problem.

Sorry no logs, cause just tested this sample TTS, which on the other hand should be fixed cause it will be the first thing many test to hear.

You may also include screenshots, however screenshots of log files are often difficult to read and parse.

If you are running Mycroft, the Support Skill helps to automate gathering this information. Simply say "Create a support ticket" and the Skill will put together a support package and email it to you.

Environment (please complete the following information):

Additional context I did notice this in beta version too, but figured it would be ironed out at final release. It might not be as big problem at the end, and might also be related to selected sound and currently only one is available. But since it's the first thing to test for, I think it would be good idea to fix those.

With that said, I haven't yet test to install this TTS to my computer, so can't yet say is there similar problem in generally, or only at sample text.

Please think carefully about whether you have modified anything in Mycroft's code or configuration files. If so, can you reproduce this on a clean installation of Mycroft? Many "bugs" turn out to be non-standard configuration errors.

krisgesling commented 2 years ago

Hey, thanks for flagging this - I'm sure Mike will be keen to fix that up.

The samples on the site are generated directly from the package, so if it exists there then it will exist in all versions of Mimic 3.

Definitely appreciate the help from native speakers on these too. We got a lot of good feedback during beta testing but I'm sure there will be more improvements to make.

Jiivee1 commented 1 year ago

mimic3_Finnish.zip

I played around bit with how Finnish word "ilmiö" (phenomenom) is pronounced in different use cases. See attacthed zip for SSML file and .wav file. You caan play SSML file yourself with command mimic3 --ssml --interactive < mimic3_Finnish.ssml.

Sometimes the ending ö sound (it is pronounced approximately like article a in "a book") is pronounced correctly, sometimes it's dropped. According to other bug reports here, other languages suffer from this, too. As @huuhaa points out, this is not really the only word mispronounced.

I'm wondering should this kind of errors be reported here or in https://github.com/MycroftAI/mimic3-voices/issues ?