Closed exotikh3 closed 5 years ago
https://github.com/parasdahal/deepnet/blob/51a9e61c351138b7dc637f4b748a0e6ca2e15595/deepnet/layers.py#L213-L216
Derivative of ReLU equal to 0 if x<0 and equal 1 if x>0, isn't it?
Sorry, finally I understood trick behind this
https://github.com/parasdahal/deepnet/blob/51a9e61c351138b7dc637f4b748a0e6ca2e15595/deepnet/layers.py#L213-L216
Derivative of ReLU equal to 0 if x<0 and equal 1 if x>0, isn't it?