search

Neuroglycerin / neukrill-net-work

NDSB competition repository for scripting, note taking and writing submissions.
MIT License
0 stars 0 forks source link

Early stopping #55

Open gngdb opened 9 years ago

gngdb commented 9 years ago

Need a model that will quickly find a local optimum so we can change hyper-parameters and figure out what's holding our model back. Suspect a good way to do this is to use the same architecture we've been working with already (with extra convolutional layer) and turn down dropout in the final layers and reducing the rate of decay of the learning rate.

gngdb commented 9 years ago

Also would like to incorporate Pylearn2 extension to detect a lack of improvement and stop training automatically. We can probably use the MatchChannel termination criteria to do this.

gngdb commented 9 years ago

Starting from Matt's quicker_learning_experiment.yaml, which already fulfils quite a few of the requirements.