accosmin / nano

C++ library [machine learning & numerical optimization] - superseeded by libnano
MIT License
1 stars 0 forks source link

Improve overfitting detection #135

Closed accosmin closed 8 years ago

accosmin commented 8 years ago

Currently overfitting is detected if the validation error does not decrease in the past 32 epochs. This is not correct as the validation error can decrease after a larger number of epochs (see using policy=all_epochs in trainers).

Potential solution: use the average loss value to check for overfitting?!