search

junxnone / ml

ML/DL/RL/RL......
6 stars 4 forks source link

Gradient Descent - NAG - Nesterov accelerated gradient #92

Open junxnone opened 5 years ago

junxnone commented 5 years ago

Reference

Momentum vs NAG

Momentum image
NAG image

NAG方法收敛速度明显加快,波动也小了很多。

junxnone commented 4 years ago

89