HuwCampbell / grenade

Deep Learning in Haskell
BSD 2-Clause "Simplified" License
1.45k stars 83 forks source link

Optimise Wengert tape for LSTM #47

Closed HuwCampbell closed 6 years ago

HuwCampbell commented 6 years ago

Unfortunately my tests and benchmarks were not opaque to the tape type. Looks like this gives a 10-25% speed up for LSTM calculations, which is ok.

I've also removed a few unnecessary S constructors.