search

weidler / semlc

Biologically Inspired Lateral Connectivity in Convoluiontal Neural Networks
MIT License
1 stars 0 forks source link

(maybe) training for 11% error net #9

Closed jlehnen closed 5 years ago

jlehnen commented 5 years ago

11% error on CIFAR-10 - layer parameter file Methodology:

  1. Train on batches 1-4, use batch 5 for validation.
  2. After about 350 epochs, validation error no longer making improvements.
  3. Fold in batch 5.
  4. Train on batches 1-5 for about 150 more epochs, until the batch 5 error is near the errors for batches 1-4. It takes forever to actually get there but after 150 epochs it's close enough.
  5. Lower learning rates (epsW) by a factor of 10 to 0.0001, train for 10 more epochs.
  6. Lower learning rates (epsW) by another factor of 10 to 0.00001, train for 10 more epochs.
  7. Stop. Test on batch 6 with --test-range=6 --multiview-test=1 --logreg-name=logprob (read more about what this does here: http://code.google.com/p/cuda-convnet/wiki/TrainingNet#Training_on_image_translations )

More details about methodology: http://code.google.com/p/cuda-convnet/wiki/Methodology

jlehnen commented 5 years ago

might not even be necessary