basveeling / wavenet

Keras WaveNet implementation
https://soundcloud.com/basveeling/wavenet-sample
1.06k stars 218 forks source link

TTS synthesis #9

Closed yhifny closed 8 years ago

yhifny commented 8 years ago

Can you show how to use this code for Text to Speech (TTS) synthesis?

basveeling commented 8 years ago

This is not in the pipeline right now. There are many ways to do this, but to get good quality you probably need strong guiding features as conditional input for the WaveNet.

If you're looking to get into the nitty gritty: check out the paper by Deepmind. They use a battery of local features for their TTS experiments. Some of them are generated by a program that generates linguistic features, and some with custom neural networks that for example generate the pitch of the voice.