carpentries-incubator / deep-learning-intro

Learn Deep Learning with Python
https://carpentries-incubator.github.io/deep-learning-intro/
Other
30 stars 37 forks source link

Add hyperparameter tuning to episode 3 #351

Closed svenvanderburg closed 2 months ago

svenvanderburg commented 1 year ago

Add explanation of hyperparamter tuning to episode 3

In this section: https://carpentries-incubator.github.io/deep-learning-intro/03-monitor-the-model/index.html#counteract-model-overfitting we are actually doing hyperparamter tuning (we are changing a hyperparameter). It is only a small extra step to do this within a for-loop.

You can get inspiration from @qualiaMachine 's script here: https://colab.research.google.com/drive/1B_F5ik6P9hfbKT2pzfMgsvFeF99_Uy9V?usp=sharing

This issue resulted from discussions in #348

svenvanderburg commented 1 year ago

I just realized we already have something like this in the final exercise related to dropout: https://carpentries-incubator.github.io/deep-learning-intro/04-advanced-layer-types/index.html#vary-dropout-rate We can slightly build that out further by adding an infobox on grid search.