search

Guiliang / Sport-Analytic-NN

Neural Network Realization of Project Sport Analytic
3 stars 1 forks source link

Activation Function Issue #4

Open Guiliang opened 7 years ago

Guiliang commented 7 years ago

1. Sigmoid is not a good Activation function

a) Sigmoid may behave poorly (rely on initialization, easy to saturate, test error too big) b) Tanh, Softsign could be taken into consideration.