search

stoltzmaniac / Basic-ML-OOP

0 stars 3 forks source link

Gradient blows up in SGD #8

Open stoltzmaniac opened 4 years ago

stoltzmaniac commented 4 years ago

When data is not normalized in LinearRegression.fit_stochastic_gradient_descent()

https://github.com/stoltzmaniac/Basic-ML-OOP/blob/master/01-Regression/Linear-Regression/Part-02/models/regression.py

The gradient blows up. Not only will it not converge, it will overflow. However, when normalized or standardized, it works just fine...