-
There's been quite a bit of interesting work recently looking at natural gradients for variational inference with exponential family q-distributions, with non-conjugate / non-exponential family likeli…
-
The torch.nn.optim docs promised me conjugate gradient descent (mentions it in the closure section), but it's not there. No references to the algorithm in the code base either :(. Not yet ported from …
-
- [x] Add scan frame
- [x] Add optimization algorithms
- [x] Setup checkpoint for scan optimization
-
Describe other approaches than hill-climbing, in case that ever falls down (e.g. if it's too slow, search space is narrow in diagonal direction, or there are too many dimensions).
tinyKACTL tersely…
-
The current nonlinear conjugate gradient (CG) method was written by myself based on the strategy of [Yuan & Dai](https://doi.org/10.1137/S1052623497318992). The line search subroutine is also written …
-
## 🚀 Feature
It would be great to have a library of optimization routines for the deterministic setting (a la `scipy.optimize`) using PyTorch autograd mechanics. I have written a [prototype library](…
-
Hi,
I saw that you have implemented competitive gradient descent in your dev-branch, thanks for giving it a try @mikkel !
I just wanted to mention that you seem to have a bug that we also found i…
f-t-s updated
4 years ago
-
I think if the Wolfe conditions are not met and "a" in the loop below is zero, the code simply runs through maxIterations without reporting it or making in progress. If the user is unaware of this, i…
-
I was wondering if there is a way to implement estimate_alpha_cf on a gpu or perhaps to speed it up a little bit. Really appreciate your answer.
-
Most of methods in the list will be implemented in the order.
- inference for Sparse Gaussian process regression (based on JMLR 2005 "A unifying view of sparse approximate Gaussian process regression…