knkski / atai

Analyze This! AI competition
1 stars 1 forks source link

Investigate CNN and LSTM #12

Open ykq1004 opened 7 years ago

ykq1004 commented 7 years ago

Investigate combining LSTM with CNN

https://github.com/fchollet/keras/blob/master/examples/imdb_cnn_lstm.py

ykq1004 commented 7 years ago

Not sure about LSTM will be useful, but found this paper/architecture using recurrent network. Seems a little bit complicated to me. Would be great to have someone else look into it. https://arxiv.org/pdf/1406.6247.pdf

ykq1004 commented 7 years ago

https://github.com/zhongwen/RAM/blob/master/ram.py

knkski commented 7 years ago

Also found this repo, which looks useful:

https://github.com/philipperemy/keras-attention-mechanism