ajay-dhangar / algo

This repository contains a collection of data structures and algorithms implemented in various programming languages. It is designed to help learners understand key concepts through hands-on examples. Contributions and improvements are welcome!
https://ajay-dhangar.github.io/algo/
MIT License
70 stars 222 forks source link

[Idea]: Stochastic Gradient Descent (SGD) #1368

Closed ananyag309 closed 1 month ago

ananyag309 commented 1 month ago

Idea Title

Stochastic Gradient Descent (SGD)

Idea Description

Stochastic Gradient Descent updates the model's parameters by calculating the gradient of the loss function for a single training example (or a small batch), rather than the entire dataset. This makes it computationally efficient but can lead to noisy updates

Potential Benefits

Implementation Suggestions (Optional)

No response

github-actions[bot] commented 1 month ago

👋 Hi @ananyag309! Thanks for opening this issue. We appreciate your contribution to the Algo project. Our team will review it soon.