I am not satisfied with PyTorch's LBFGS optimizer. The pytorch-minimize library:
"Although PyTorch offers many routines for stochastic optimization, utilities for deterministic optimization are scarce; only L-BFGS is included in the optim package, and it's modified for mini-batch training.""
They also mention that SciPy does not offer automatic differentiation.
I am not satisfied with PyTorch's LBFGS optimizer. The pytorch-minimize library:
"Although PyTorch offers many routines for stochastic optimization, utilities for deterministic optimization are scarce; only L-BFGS is included in the optim package, and it's modified for mini-batch training.""
They also mention that SciPy does not offer automatic differentiation.