hanbt / learn_dl

Deep learning algorithms source code for beginners
Apache License 2.0
1.2k stars 988 forks source link

卷积神经网络里面的根据链式求导法则写错了 #24

Open xuFabius opened 6 years ago

xuFabius commented 6 years ago

https://www.zybuluo.com/hanbingtao/note/485480 根据链式求导法则,应该是:E_d对a^{l}求偏导,再乘以a^{l}对net^{l-1}求偏导。你写成E_d对a^{l-1}求偏导,再乘以a^{l-1}对net^{l-1}求偏导。

FlyingCat-fa commented 6 years ago

你也可以写成E_d对a^{l}求偏导,再乘以a^{l}对a^{l-1}求偏导,再乘以a^{l-1}对net^{l-1}求偏导,链式求导法则没毛病呀