yos1up / DNC

Differentiable Neural Computers
129 stars 34 forks source link

Scaling Memory-Augmented Neural Networks with Sparse Reads and Writes (New DeepMind paper) #3

Open Zeta36 opened 7 years ago

Zeta36 commented 7 years ago

@yos1up, do you think you would be able to implement the sparse version oft eh DNC mentioned here: https://deepmind.com/blog/deepmind-papers-nips-part-3/?

The full paper is here: https://arxiv.org/pdf/1610.09027v1.pdf

It would be wonderful to check this new feature in your code. By the way, I'm testing in a fork your development and it works like a charm. You can see here: https://github.com/Zeta36/DNC a new task for the generalization of sequence of sums and it's great the way it works.

Regards.

optimass commented 7 years ago

I would also love to see an implementation of a Sparse DNC in chainer !