weka511 / learn

Experiments in machine learning
GNU General Public License v3.0
0 stars 0 forks source link

flowers.py is overtraining #12

Closed weka511 closed 2 years ago

weka511 commented 4 years ago

image

weka511 commented 4 years ago

Over training is obvious after 10 epochs.

weka511 commented 4 years ago

image

weka511 commented 4 years ago

Just tried Dopout(0.5) - a small improvement. image

weka511 commented 4 years ago

image regularizers.l2(0.001)

weka511 commented 4 years ago

image kernel_regularizer=regularizers.l2(0.01)

weka511 commented 4 years ago

I've tried training with l1 and l2 filters, weight = 1e-3/1e-3. Accuracy plateaus at 0.8018 and 0.6703. image image

weka511 commented 4 years ago

Best run so far (uses more complex network and slower training rate). Which is responsible? image

weka511 commented 2 years ago

Don't fix