search

kimpro82 / MyPractice

Born in October and learn like octopus
0 stars 0 forks source link

R : Audacity of Gradient Descent Algorithm #168

Open kimpro82 opened 2 years ago

kimpro82 commented 2 years ago

I feel the so-called gradient descent algorithm too narrow-minded. I think I have already more efficient way.

kimpro82 commented 2 years ago

SGD; Stochastic Gradient Descent https://en.wikipedia.org/wiki/Stochastic_gradient_descent

Adam https://en.wikipedia.org/wiki/Stochastic_gradient_descent#Adam