search

barronalex / Tacotron

Implementation of Google's Tacotron in TensorFlow
236 stars 80 forks source link

loss exploded #7

Closed YisenWang closed 7 years ago

YisenWang commented 7 years ago

Does anyone run into this issue ? In the training process, "loss exploded" threw out and the training is stopped.

candlewill commented 7 years ago

Yes. I decreased the learning rate, and then restored training.

YisenWang commented 7 years ago

@candlewill how large is your lr?

candlewill commented 7 years ago

0.001, 0.0005, 0.0003, 0.0001, 0.00005, ...