Closed mxc19912008 closed 6 years ago
Change Tanh to Relu since there is no linear part in tanh. It should be relu instead.
Tanh has a linear part. Check this image.
Your edit it true for RELU, but the provided intuition applies to Tanh too as well.
Yeah, right! Thanks for pointing it out!
Change Tanh to Relu since there is no linear part in tanh. It should be relu instead.