-
Though mentioned in meeting minutes, making my development on this public. Will tick things off as and when they are completed.
## Checklist
Add:
- [ ] Dual parameterisation of [Vincent et al.…
-
In NES algorithms do we use backpropogation from the last layers gradients(computed by the objectve function). I am curious as to how to optimize the hidden layers since they are not directly affectin…
-
# Feature Request
Write notebook with mathematical background and illustrate performance advantage of using natural gradients.
-
-
There's been quite a bit of interesting work recently looking at natural gradients for variational inference with exponential family q-distributions, with non-conjugate / non-exponential family likeli…
-
![A GIF or MEME to give some spice of the internet](https://media.giphy.com/media/HzPtbOKyBoBFsK4hyc/giphy.gif?cid=790b7611uxgwd2nty2bphzkapx144myrtpfsy3xddweznfgf&ep=v1_gifs_search&rid=giphy.gif&…
-
It's currently impossible to draw repeating/mirrored gradients (at least, in a single call) in Canvas2D.
- CSS [supports](https://www.w3.org/TR/css-images-3/#funcdef-repeating-radial-gradient) repe…
-
At default, inference methods in GP module will compute gradients wrt model parameters, which is not always necessary.
- offer users an option to ask inference methods do not compute these gradients.
…
-
### 🚀 The feature, motivation and pitch
Discussion motivation: https://discuss.pytorch.org/t/higher-order-gradients-of-ctcloss/35019
Hi! I'm trying to do double backward for CTC loss function an…
-
https://github.com/wiseodd/natural-gradients/blob/7d51f19d315cb393a52a371162aaf2e27d20dbaa/numpy/toy/full_fisher.py#L47
I have no idea how do you compute fisher information matrix. Specifically, I …