-
### Feature
I kindly request the addition of support for the Kronecker-Factored Approximate Curvature (KFAC) optimization technique in LSTM and GRU layers within the existing KFAC Optimizer. Curren…
-
## 🚀 Feature
Add the [Kronecker-factored Approximate Curvature (KFAC)](https://arxiv.org/abs/1503.05671) optimizer and/or [E-KFAC](https://arxiv.org/abs/1806.03884).
## Motivation
These are both …
n-gao updated
3 years ago
-
Hi,
I am trying to obtain a Kronecker-factored Laplace approximation for an entire Resnet (not only for the last layer) but obtain an error that some layers are not supported (I suspect this is due…
-
* [Link](https://www.mitpressjournals.org/doi/10.1162/089976698300017746)
* Title: Natural Gradient Works Efficiently in Learning
* Keywords (optional):
* Authors (optional):
* Reason (opti…
-
Hi all,
When I try to run a Mujoco environment with ACKTR algorithm it doesn't work. Here is the full log:
```
Training acktr on mujoco:Hopper-v2 with arguments
{'network': 'mlp'}
Traceback …
R1ckF updated
6 years ago
-
According to the [docs](https://github.com/tensorflow/kfac/blob/master/kfac/python/keras/README.md), this optimizer is supposed to `converge much faster (>3.5x) and with fewer iterations (>14x) than S…
ghost updated
2 months ago
-
http://arxiv.org/abs/1503.05671
Any chance someone could implement this for lasagne.updates?
It could be very good as it overcomes some of the issues with HF while also being faster to converge than…
-
## 🚀 Feature
I would like to request the addition of support for Recurrent Neural Networks (RNNs) in the KFACOptimizer class. Currently, the KFACOptimizer class works for linear and 2D convolution …
-
Song Y, Song J, Ermon S. [Accelerating natural gradient with higher-order invariance](http://proceedings.mlr.press/v80/song18a/song18a.pdf).
-
Erre kíváncsi lennék:
Exploring Weight Agnostic Neural Networks
Tuesday, August 27, 2019
Posted by Adam Gaier, Student Researcher and David Ha, Staff Research Scientist, Google Research, Tokyo
…