thomasbrandon / mish-cuda

Mish Activation Function for PyTorch
MIT License
147 stars 67 forks source link

test_gradgrad fails on cpu and gpu #15

Open ifeherva opened 3 years ago

ifeherva commented 3 years ago

I built the library just fine, all unit tests complete except test_gradgrad().

The error I get is 'Numerical gradient for function expected to be zero'.

Note, I am building this on a host that has no GPU.

Using Pytorch 1.6

ifeherva commented 3 years ago

Just tested on gpu and the same error occurs. I am wondering if this impacts the usage of the operator.