search

batzner / indrnn

TensorFlow implementation of Independently Recurrent Neural Networks
https://arxiv.org/abs/1803.04831
Apache License 2.0
515 stars 129 forks source link

How to add dropout to indrnn cells #22

Closed psyxusheng closed 5 years ago

psyxusheng commented 5 years ago

Looking forward to reply~~

Sunnydreamrain commented 5 years ago

Not sure how it is done in tensorflow, but in pytorch, you can write a fuction to share the dropout mask over time as in the following line.
https://github.com/Sunnydreamrain/IndRNN_pytorch/blob/master/action_recognition/Indrnn_action_network.py#L26

Anyway, the key is to share the dropout mask over time, which should be easily done.

psyxusheng commented 5 years ago

Thank you