vktrbr / optimization_ml

Optimization in ML
MIT License
10 stars 1 forks source link
bfgs brent-algirithm conjugate-gradient-descent exponential-regression golden-section-search gradient-descent linear-regression optimization plotly polynomial-regression python streamlit successive-parabolic-interpolation visualization

Optimization

Table of Contents

One-dimensional optimization

Algorithms:

  1. Golden-section search
  2. Successive parabolic interpolation
  3. Brent's method
  4. Broyden–Fletcher–Goldfarb–Shanno algorithm

    App with visualization: https://.../OneDimensionalOptimization/streamlit_app.py

Multi-dimensional Optimization

Algorithms:

  1. Gradient Descent
  2. Nonlinear conjugate gradient method

    App with visualization: https://.../MultiDimensionalOptimization/streamlit_app.py

Regression

Algorithms:

  1. Linear
  2. Polynomial
  3. Exponential

    App with visualization: https://.../Regression/streamlit_app.py

Classification

Algorithms:

  1. SVM
  2. Logistic
  3. Logistic with RBG

    App with visualization: https://.../Classification/streamlit_app.py