search

danmcleran / tinymind

Tinymind is a Neural Network and Machine Learning project intended to provide a C++ template library for neural nets and machine learning algorithms within embedded systems.
MIT License
8 stars 2 forks source link

Stochastic Gradient Descent #36

Open danmcleran opened 7 months ago

danmcleran commented 7 months ago

Look into efficient stochastic methods in lieu of backpropagation via gradient descent. e.g. Adam https://arxiv.org/pdf/1412.6980.pdf