Open bremen79 opened 4 years ago
Hi, the subgradient of the relu is 0 or 1, while it seems that you are returning 0 or the input itself. A bug?
yes, I am wrong, I had changed the Relu derivative function. 0 or 1. thanks
Hi, the subgradient of the relu is 0 or 1, while it seems that you are returning 0 or the input itself. A bug?