search

shawntan / neural-turing-machines

Attempt at implementing system described in "Neural Turing Machines." by Graves, Alex, Greg Wayne, and Ivo Danihelka. (http://arxiv.org/abs/1410.5401)
https://blog.wtf.sg/category/neural-turing-machines/
465 stars 96 forks source link

Question: Optimal head setting #2

Open JanTkacik opened 9 years ago

JanTkacik commented 9 years ago

How do you know what is optimal controller output for read and write heads ?

shawntan commented 9 years ago

I don't. The current architecture for the controller is just the simplest guess (slapping everything on the hidden layer). You can train a model that works well, it's just I had to resort to some simple curriculum learning method.

JanTkacik commented 9 years ago

Thanks, I will try it.