Closed cvhuang closed 5 years ago
In the paper Self-Normalizing Neural Networks, the SELU function is given by lambda∗(max(0,x)+min(0,alpha∗(exp(x)−1))) not max(0,x)+min(0,alpha∗(exp(x)−1)). So is the cpu version. Is that right : )
Fixed in 0.17.3, thank you.
drnikolaev
commented
5 years ago
In the paper Self-Normalizing Neural Networks, the SELU function is given by lambda∗(max(0,x)+min(0,alpha∗(exp(x)−1))) not max(0,x)+min(0,alpha∗(exp(x)−1)). So is the cpu version. Is that right : )