search

carpentries-incubator / deep-learning-intro

Learn Deep Learning with Python
https://carpentries-incubator.github.io/deep-learning-intro/
Other
30 stars 36 forks source link

Rename step 9. hyperparameter tuning to 9. Refining the model #270

Closed cpranav93 closed 11 months ago

cpranav93 commented 1 year ago

Quoting @svenvanderburg from #268: "Like we discussed I feel it would more sense to rename this step to 'Refine the model'.

I think in machine learning practice hyperparameter tuning or hyperparameter optimization is an automated process of finding the best hyperparameters. The simplest way to to this is a grid search. See https://en.wikipedia.org/wiki/Hyperparameter_optimization

'Refining the model' would feel better in this case, because we are manually changing hyperparameters of the model (with a conceptual framework in mind). Of course the automated hyperparameter tuning is a subset of 'finetuning the model'.

If you agree, you can create an issue for renaming this step everywhere in the lesson material."

I think he has a point that the statement hyperparameter tuning can mean different things to different users. So we can change this to refining the model across all the episodes which would then have hyperparameter tuning contained within. Thoughts? @dsmits, @CunliangGeng

CunliangGeng commented 1 year ago

I like the new name Refine the model, which could contain changing architecture, tuning hyperparameters, using more data...