issues
search
junxnone
/
ml
ML/DL/RL/RL......
6
stars
4
forks
source link
Gradient Descent - NAG - Nesterov accelerated gradient
#92
Open
junxnone
opened
5 years ago
junxnone
commented
5 years ago
Reference
[ ]
深度学习优化函数详解(5)-- Nesterov accelerated gradient (NAG)
Momentum vs NAG
Momentum
NAG
NAG方法收敛速度明显加快,波动也小了很多。
junxnone
commented
4 years ago
89
Reference
Momentum vs NAG