-
Hi,
I am having trouble implementing optax LBFGS with equinox types. I am trying to run a linear regression model using this notebook https://github.com/ubcecon/ECON622/blob/master/lectures/lectures/…
-
Although I know most of people use ADAM or SGD for the optimization of weight in NN. However, for some small NN architecture, the optimization method with line search (e.g., LBFGS) would be far more e…
-
Are there any plans on implementing the LBFGS optimizer? It seems to perform better and faster than ADAM for small sample sizes in my experience with sklearn python. Having this implemented will help …
-
添加LBFGS优化方法
对标torch.optim.LBFGS
目前应用于天枢框架下某力学计算任务,指标基本一致,应该能适用于大部分任务上
不过torch本身对这个算子的实现并不是很好,test_case里面有很多的if_else分支没有跑到
先占坑,算法大体写完了,接口和测试还没有写好,过两天编译过了会陆续上传。实现过程中碰到很多问题,所以开了个issue。
-
Is LBFGS implemented or it just calls GRADIENT_DESCENT inherently?
Because: With GRADIENT_DESCENT and LBFGS the computed errors are exactly same which I thought to improve with LBFGS or at least chan…
-
Hi, is there a way to use `tfp.optimizer.lbfgs_minimize` as Keras optimizer?
This would be quite useful in certain cases where the loss function is approximately quadratic.
A colleague of mine wou…
Hoeze updated
3 years ago
-
## Any insights on the performance/ pros, cons of two optimizers:
##
## Can someone give a brief explanation of how both works, what are their respective advantages and disadvantages, and how they …
-
Hi,
I am trying to use the `BaggingRegressor` model, with shallow estimators, on a small dataset, for which the LBFGS optimizer usually gives good results with a single estimator. However I see th…
-
I am trying to use L-BFGS and related optimizers with nnx + optax, but running into trouble. It might be that `optax` has a slightly different optimization interface in those cases: https://optax.rea…
-
Implementation: https://github.com/pytorch/pytorch/blob/master/torch/optim/lbfgs.py#L308