Open chathasphere opened 4 years ago
Namely, get an understanding of why RNN's outperform, say, Markov chains.
Hinton (http://www.cs.toronto.edu/~hinton/absps/momentum.pdf) compares RNN's to Deep Neural Networks with one layer per timestep.
https://stackoverflow.com/questions/45341769/why-should-we-use-rnns-instead-of-markov-models
Namely, get an understanding of why RNN's outperform, say, Markov chains.
Hinton (http://www.cs.toronto.edu/~hinton/absps/momentum.pdf) compares RNN's to Deep Neural Networks with one layer per timestep.