search

dragen1860 / Deep-Learning-with-TensorFlow-book

深度学习入门开源书，基于TensorFlow 2.0案例实战。Open source Deep Learning book, based on TensorFlow 2.0 framework.
http://www.ai101edu.com
13.21k stars 4.08k forks source link

11.6节，梯度弥散和梯度爆炸相关论述 #165

Open TanShiKai opened 4 years ago

TanShiKai commented 4 years ago

当𝜕𝑡/𝜕𝑖的值大于1时，多次连乘运算会使得𝜕𝑡/𝜕 𝑖的元素值爆炸式增长 建议修改为 当𝑾_hh的最大特征值(Largest Eignvalue)大于1时，多次连乘运算会使得𝜕𝑡/𝜕 𝑖的元素值爆炸式增长