issues
search
accosmin
/
nano
C++ library [machine learning & numerical optimization] - superseeded by libnano
MIT License
1
stars
0
forks
source link
Investigate minibatch LBFGS
#184
Closed
accosmin
closed
6 years ago
accosmin
commented
6 years ago
see
https://arxiv.org/pdf/1605.06049v2.pdf
also this as it may be related:
https://arxiv.org/pdf/1609.04836.pdf
need to extend iterator_t to have an overlap between consecutive batches
accosmin
commented
6 years ago
should also implement a minibatch trainer: run a batch solver for couple of iterations with the SAME minibatch (parameters: minibatch = 32-1024, iters = 4-32)