Smerity / sha-rnn

Single Headed Attention RNN - "Stop thinking with your head"
1.18k stars 133 forks source link

think about tensorflow? #4

Closed Crescentz closed 4 years ago

Smerity commented 4 years ago

Good suggestion! Whilst the model itself is relatively simple and should be easily re-implemented in Tensorflow I haven't used TF for some time however and don't know what the best practices would be. I tend to think this would do well as a separate repository too.