[Help] Share your TTS models

erogol commented 3 years ago

Please consider sharing your pre-trained models in any language (If the licences allow that).

We can include them in our model catalogue for public use by attributing your name (website, company etc.).

That would enable more people to experiment together and coordinate, instead of individual efforts to achieve similar goals.

That is also a chance to make your work more visible.

You can share in two ways;

Share the model files with us and we serve them with the next :frog: TTS release.
Upload your models on GDrive and share the link.

Models are served under .models.json file and any model is available under tts CLI or Server end points. More details...

(previously mozilla/TTS#395)

enjikaka commented 3 years ago

Any ELI5 tutorial/doc for creating a dataset for your own language/dialect?

erogol commented 3 years ago

Not sure if it is ELI5, but there is this link https://github.com/coqui-ai/TTS/wiki/What-makes-a-good-TTS-dataset

Also, @thorstenMueller has created a TTS dataset from the gecko so he might have valuable comments if you have specific questions.

thorstenMueller commented 3 years ago

Feel free to ask specific question. I'd happy to share my experiences on recording a new dataset here.

Find/Create a text corpus to record (one sentence = 1 recording)
Replace numbers to text
Create csv file from corpus
Check Mimic-Recording-Studio from Mycroft as recording environment (https://github.com/MycroftAI/mimic-recording-studio)
Start recording
- Constant speed while recordings
- Speak all chars clearly
- Speak in neutral voice
- Use good microphone equipment
- Find a recording place without random noise

Sadam1195 commented 3 years ago

Hi @erogol , thank you for the amazing work, from Mozilla TTS to coqui-ai. Although Mozilla seemed perfect to me as it had wider community reach, just hope this grows even wider and faster than Mozilla. I am planning to share my models for Spanish and Italian using (Taco2 600k steps + WaveRNN). Audio quality seems to be good but I need to train it a bit more and also ask dataset providers if that would be okay if I make the models public. Fingers crossed.

Let me know if I can contribute in any way I have Google Colab Pro resources laying around free.

+-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | No running processes found | +-----------------------------------------------------------------------------+

erogol commented 3 years ago

@Sadam1195 thx for the amazing work :rocket::rocket:.

I really hope we can include your models, of course with the right attribution going to you.

Just waiting for your signal.

For general contribution, this is a nice place to start https://github.com/coqui-ai/TTS/blob/main/CONTRIBUTING.md

If you just like to train models, let me know we can also find new datasets to attack.

Sadam1195 commented 3 years ago

I really hope we can include your models, of course with the right attribution going to you. I hope they allow me, otherwise I would see it as wasting my time and effort. Just waiting for your signal. I will let you know when I get the confirmation. If you just like to train models, let me know we can also find new datasets to attack. Training models on colab can be a bit annoying as sessions often get disconnected even with all the tricks in the book.

Nonetheless, I would love to train model on new datasets (if you have any) specially in the languages in which TTS models haven't been made public yet.

kaiidams commented 3 years ago

Hello,

I've just started to train a public domain Japanese dataset https://github.com/kaiidams/Kokoro-Speech-Dataset with Tacotron 2 of the latest master of https://github.com/mozilla/TTS on Google Colab Free. After 19K steps, I can hear what he says, although it is metallic.

To proceed, I'd like to know which branch and repo do you recommend for me to use? https://github.com/erogol/TTS_recipes seems a bit old.

Sadam1195 commented 3 years ago

To proceed, I'd like to know which branch and repo do you recommend for me to use? https://github.com/erogol/TTS_recipes seems a bit old.

Please use this https://github.com/coqui-ai/TTS instead of https://github.com/mozilla/TTS and use the latest main branch. @kaiidams

kaiidams commented 3 years ago

@Sadam1195 @erogol

I trained Tacotron 2 for 130K steps with this code https://github.com/kaiidams/TTS/tree/kaiidams/kokoro which was forked from the latest main. https://drive.google.com/drive/folders/1-1_HB-ogmvD-qYaHm8D5Xp1pWq9HKhB_?usp=sharing The included sample.wav was generated with vocoder_models/universal/libri-tts/wavegrad.

The input of the model is Romanized Japanese text. It requires some dependencies like MeCab to convert texts from ordinary ones. The dataset is the public domain and the reader knows about the dataset. I think I can provide Python code for text conversion.

erogol commented 3 years ago

@kaiidams if you can send a PR for text conversion something similar to the Chinese API we have, with the model, would be a great contribution.

zubairahmed-ai commented 3 years ago

Feel free to ask specific question. I'd happy to share my experiences on recording a new dataset here.

Find/Create a text corpus to record (one sentence = 1 recording)

Replace numbers to text

Create csv file from corpus

Check Mimic-Recording-Studio from Mycroft as recording environment (https://github.com/MycroftAI/mimic-recording-studio)

Start recording

Constant speed while recordings

Speak all chars clearly

Speak in neutral voice

Use good microphone equipment

Find a recording place without random noise

Any reason why this and this isn't in the readme? I had to look up training to reach here

thorstenMueller commented 3 years ago

Hi @zubairahmed-ai. Here's a talk a made on how to record a voice dataset if that's helpful for you.

https://youtu.be/m-Uwb-Bg144

zubairahmed-ai commented 3 years ago

@thorstenMueller Perfect timing, thank you

zubairahmed-ai commented 3 years ago

Oh just realized this talk happened during recent Google I/O and I somehow didn't catch it while watching other videos :)

zubairahmed-ai commented 3 years ago

@thorstenMueller Thanks so much for the great video explaining your process in details with some tips. I'll make sure I follow that, do you plan to give a try to other models besides Tacotron-2? like Align-TTS?

thorstenMueller commented 3 years ago

You're welcome @zubairahmed-ai :-). I'm currently finishing some recording stuff for my emotional dataset and train a Fullband-MelGAN vocoder. So i've no time left to look at other models like Align-TTS. But feel free to train a "Thorsten" model with Align-TTS ;-).

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

ravi-maithrey commented 3 years ago

Asking people to share their models can also be added to the CONTRIBUTING.md, since it is asking for contributions. I'd be up to doing that, if no one has taken it up yet?

erogol commented 3 years ago

yeah good point. Feel free to take on it.

ghost commented 3 years ago

I would like to contribute my own model.. but I stuck in middle.. I have created dataset(LJSpeech) of my own voice . For training my model I need config.json file , so can anyone provide me the template of config.json file for LJSpeech dataset format required to train my model.

Thanks in Advance

erogol commented 3 years ago

@ManoBharathi93 you can start from the LJSpeech recipes in the recipes folder and change the config fields for your dataset specs. You can find more info here https://tts.readthedocs.io/en/latest/

ghost commented 3 years ago

@erogol thanks a lot sir

ghost commented 3 years ago

Hello folks, How can I add drop-down Menu to list available models(downloaded models) in WEB-UI and when I change the server.py file the web interface is not changing ? please mention which file name want to make changes impact in WEB-UI..

godspirit00 commented 3 years ago

I'd like to share a Tacotron2-DCA model and a Univnet model I trained on the Nancy corpus.

Here is a sample:

https://user-images.githubusercontent.com/16176151/136530668-4b037ea5-8b26-4543-8e89-072f04f9c658.mp4

The link to the models: https://drive.google.com/drive/folders/1bMNOjjYxcCkgwkcYAlsPR3qM4hZQzAOR?usp=sharing

Thanks again for the great work!

erogol commented 3 years ago

@godspirit00 the quality is awesome.

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions. You might also look our discussion channels.

coqui-ai / TTS

[Help] Share your TTS models #380