search

parasdahal / deepnet

Educational deep learning library in plain Numpy.
https://deepnotes.io/implementing-cnn
MIT License
320 stars 83 forks source link

Derivative of ReLU #9

Closed exotikh3 closed 5 years ago

exotikh3 commented 5 years ago

https://github.com/parasdahal/deepnet/blob/51a9e61c351138b7dc637f4b748a0e6ca2e15595/deepnet/layers.py#L213-L216

Derivative of ReLU equal to 0 if x<0 and equal 1 if x>0, isn't it?

exotikh3 commented 5 years ago

Sorry, finally I understood trick behind this