Suggestion: Add optimization functions, ml algorithms under `machine_learning` folder

[Navaneeth-Sharma]

I would like to suggest adding Optimization functions, machine learning and deep learning algorithms in this repository. This can be added in a separate folder called machine_learning folder. Further, this folder can contain various algorithms that are used in machine learning and deep learning.

Initially, these Optimization functions can be added under machine_learning/optimization/

• [x] Gradient Descent
• [ ] Stochastic Gradient Descent (SGD)
• [ ] Mini-Batch Gradient Descent
• [ ] Adam (Adaptive Moment Estimation)
• [ ] RMSprop (Root Mean Square Propagation)
• [ ] AdaGrad (Adaptive Gradient Algorithm)

And these in machine_learning/

• [x] Linear Regression
• [ ] Logistic Regression
• [ ] Decision Trees
• [ ] Random Forest
• [ ] Support Vector Machines (SVM)
• [ ] K-Nearest Neighbors (K-NN)
• [ ] Naive Bayes
• [ ] K-Means Clustering
• [ ] Principal Component Analysis (PCA)

[siriak]

I like the idea, let's do that

[aryan20s]

Linear regression has been merged (#579), so requesting you to check that part

[GreatRSingh]

@Navaneeth-Sharma @siriak Lets also keep loss functions in that folder. #582

[github-actions[bot]]

This issue has been automatically marked as abandoned because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.

[GreatRSingh]

@siriak hey, can you do something, so that it doesn't get automatically close. I think it should remain open.

[sahuishan01]

Hello I am new to open source contribution, I would love to help in implementing some of the optimisation techniques. Kindly let me know if someone is already working on them, or I can start working with few?

[GreatRSingh]

You can start working on them

On Sun, Feb 11, 2024, 2:46 AM Ishan Sahu @.***> wrote:

Hello I am new to open source contribution, I would love to help in implementing some of the optimisation techniques. Kindly let me know if someone is already working on them, or I can start working with few?

— Reply to this email directly, view it on GitHub https://github.com/TheAlgorithms/Rust/issues/578#issuecomment-1937165451, or unsubscribe https://github.com/notifications/unsubscribe-auth/ALY6WHV6IGVJU2FQ6FVS5VDYS7PTRAVCNFSM6AAAAAA6BDORXGVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSMZXGE3DKNBVGE . You are receiving this because you commented.Message ID: @.***>

[haswanth10]

Pull request has been raised for K-Nearest Neighbors Algorithm (https://github.com/TheAlgorithms/Rust/pull/723). Request you to please check on that

[jkauerl]

Hello, I would love to start contributing to this project. Specifically on optimization algorithms like Stochastic Gradient Descent (SGD) or Mini-Batch Gradient Descent. Are they still possible to work on them?

[siriak]

Sure, you can start implementing them

[prkbuilds]

Hey, I've implemented the logistic regression under this issue, please review the PR for any changes you want - #832