OliverFM / rust_light

A tensor processing library in rust.
MIT License
3 stars 0 forks source link

Oliver/multidimensional autograd for tanh #32

Closed OliverFM closed 1 year ago

OliverFM commented 1 year ago

Fixes the autograd rule for tanh. I suspect this is not the end of it though, since I will probably need to rethink the Jacobian Vector Product more carefully, but I am trying to focus on TDD for this one. At the moment I have verified that my calculations are correct with pytorch.