uu-sml / sml-book-page

Page for the SML book
48 stars 16 forks source link

Standardization of the feature matrix before fitting a regularized regression #29

Closed dmitrijsk closed 3 years ago

dmitrijsk commented 3 years ago

Please consider a short discussion (Chapter 5.4 Regularization) of whether or not the feature matrix should be standardized before fitting a regularized regression, such as Ridge or Lasso. The original article seems to assume standardization in the definition and all examples. The scicit-learn documentation mentions standardization as a practical consideration. This was not obvious to me when first time reading about regularization. Thank you for a great book and for considering this suggestion!

andreas-lindholm commented 3 years ago

Good point. We will take this into consideration for future updates.