search

shawntan / neural-turing-machines

Attempt at implementing system described in "Neural Turing Machines." by Graves, Alex, Greg Wayne, and Ivo Danihelka. (http://arxiv.org/abs/1410.5401)
https://blog.wtf.sg/category/neural-turing-machines/
464 stars 97 forks source link

Contact the Authors #1

Open turnersr opened 9 years ago

turnersr commented 9 years ago

Have you contacted the authors in order to learn more about the training algorithm used in the paper?

menduz commented 9 years ago

I tryed without success

El jue, nov 20, 2014 18:08, turnersr notifications@github.com escribió:

Have you contacted the authors in order to learn more about the training algorithm used in the paper?

— Reply to this email directly or view it on GitHub https://github.com/shawntan/neural-turing-machines/issues/1.

shawntan commented 9 years ago

Same here.

JanTkacik commented 9 years ago

I have tried too. No answer so far.

jarrelscy commented 9 years ago

I think they said they use RMSProp.

shawntan commented 9 years ago

Yes and I've tried RMSProp. I'm looking for more specifics, like initialisation parameters, gradient clipping, etc.

jarrelscy commented 9 years ago

Ah yeah, sorry just realised you'd already had that.