Kyubyong / deepvoice3

Tensorflow Implementation of Deep Voice 3
453 stars 113 forks source link

Status log #9

Open Kyubyong opened 7 years ago

Kyubyong commented 7 years ago

22 Nov. 2017. Has completed the first draft. I've tested the current hyperparameters on only Nick dataset which is 8 hours long, but not on LJ which is 24 hours long. The results were not good, not terrible. As I tried with the same hyperparameters as the original paper with no success, I changed some of them. Amongst them are application of dilation and positional embedding instead of positional encoding. I found the attention plot of the last layer looks monotonic somewhat, but not clearly. I think the key signal that the network works is, of course, the attention plots.

lsq357 commented 7 years ago

Thank you for your great work! Can you show me the environment such as python2 or python3, tensorflow version and so on?

Kyubyong commented 7 years ago

Sure. Python 2 TF 1.3 linux

lsq357 commented 7 years ago

Thanks! I am using LJSpeech-1.0 dataset to train, Can you show me the alignment curve after convergence and how many steps I need to train only using Nick dataset.

lsq357 commented 6 years ago

Any plan to add `JOINT REPRESENTATION OF CHARACTERS AND PHONEMES' as the (deepvoice3,part 3.2) saying image and the keithito tacotron experiments showed faster convergence.

Also, as my experiments, JOINT REPRESENTATION OF CHARACTERS AND PHONEMES does coverge faster.

arijit17 commented 6 years ago

Do you have the synthesized speech files somewhere?

chenxf0619 commented 6 years ago

hello, Kyubyong, we have pull your code, we test your code with LJ-speech data. we found the synthesized wav files has nothing to do with the content of the "test_sents.txt". Do you have any guide for us?