accosmin / nano

C++ library [machine learning & numerical optimization] - superseeded by libnano
MIT License
1 stars 0 forks source link

Improve stochastic optimizers #108

Closed accosmin closed 8 years ago

accosmin commented 8 years ago

Need to improve tuning their hyper-parameters because there is a BIG variance in the resulting train/test error.

Possible solutions:

accosmin commented 8 years ago

There might be a bug in tuning the stochastic optimizers: the selected configuration does not correspond to the minimum training loss.

accosmin commented 8 years ago

Fixed the bug related to tuning. Many more samples are used now for training, thus hyper-parameter tuning is much more robust.

accosmin commented 8 years ago

Fixed all stochastic optimizers except AG-based ones.

accosmin commented 8 years ago

Fixed AG-based optimizers as well.