search

I159 / go_deep

Neural network framework on pure Go
MIT License
1 stars 0 forks source link

Activation function derivative #5

Closed I159 closed 6 years ago

I159 commented 7 years ago

The update formula is:

δl=((wl+1)Tδl+1)⊙σ′(zl)

Where σ′(zl) is a partial derivative of an activation function with respect to output. SoftMax http://www.aiportal.ru/images/math/math_971.5_09359c32219c5c81ae4011f679e8d160.png