search

andrewliao11 / dni.pytorch

Implement Decoupled Neural Interfaces using Synthetic Gradients in Pytorch
118 stars 42 forks source link

Implement DNI for LSTM #2

Closed rishikksh20 closed 7 years ago

rishikksh20 commented 7 years ago

Is it possible to use LSTM with synthetic gradient for NLP ? If yes then please give some coding reference using pytorch

andrewliao11 commented 7 years ago

hi @rishikksh20 , from the paper section3.2, the author apply dni to rnn. For the implementation, i think it's similar to the code that i implement so far