Closed Paper99 closed 7 years ago
I noticed that your update cancelled the clip-gradients, is it right? Why?
Hi, we don't need to set clip-gradients since there is not gradient explosion problem with following solver: Adam with 1e-4 learning rate.
Many thanks!
I noticed that your update cancelled the clip-gradients, is it right? Why?