IssamLaradji / sls

Implements stochastic line search
117 stars 23 forks source link

Fixed boundary boundary checking #10

Closed Demirrr closed 1 year ago

Demirrr commented 2 years ago

Hello all,

I was wondering whether increasing this fixed 100 iterations in here would improve the results even further?

IssamLaradji commented 1 year ago

In our experiments, we found that part of the optimization converges very quickly, often in about 5 iterations, so 100 iterations seemed more than enough.

Of course, that's dataset and problem specific and it might be worth having it as a hyperparameter.

Demirrr commented 1 year ago

Cheers!