Question: Why is there a low pass filter on the loss function?

shawntan / neural-turing-machines

Attempt at implementing system described in "Neural Turing Machines." by Graves, Alex, Greg Wayne, and Ivo Danihelka. (http://arxiv.org/abs/1410.5401)

https://blog.wtf.sg/category/neural-turing-machines/

465 stars 96 forks source link

Question: Why is there a low pass filter on the loss function? #9

Closed cbames closed 9 years ago

cbames commented 9 years ago

Why wouldn't you just save the best model without reference to the surrounding models?

shawntan commented 9 years ago

Sorry, I worked on that halfway and didn't complete it. The intention was to use that average to decide when to increase the difficulty of the training examples. I shouldn't have commited that.

cbames commented 9 years ago

Awesome. thanks for the insight.