search

redhairedcelt / Final-Project-Group1

ML2 Final Project for Group 1
MIT License
1 stars 1 forks source link

Research and Identify State of the Art Methods for RNN/LSTM/GRU #5

Open redhairedcelt opened 3 years ago

redhairedcelt commented 3 years ago

Empirical Evaluation of Gated Recurrent Neural Networks on Sequence Modeling: https://arxiv.org/pdf/1412.3555v1.pdf

GRU and LSTM beat out traditional RNN with tanh

redhairedcelt commented 3 years ago

Develop a Word Level Neural Language Model: https://machinelearningmastery.com/how-to-develop-a-word-level-neural-language-model-in-keras/

Standard two layer LSTM, fully connected hidden layer.

redhairedcelt commented 3 years ago

Bi-Direction RNNs: https://www.analyticsvidhya.com/blog/2019/01/sequence-models-deeplearning/