-
First, thank you for creating and releasing this invaluable resource.
# What I am trying to do
I would like to combine `kfax-jax` with [fused attention from `pallas`](https://github.com/google/…
-
thanks much for sharing the baselines. out of all the implementations, the ```kfac.py``` is really hard to follow. I was wondering if you can add some more high level comments to this file. Thanks aga…
-
Hi,
Thanks for the repo! This is really a nice work.
I am planning to calculate the KFAC with backpack. But it raises the following error:
```
NotImplementedError: Extension saving to kfac doe…
-
In the pytorch implementation of kfac, G1_ is computed as:
G1_ = 1/m * a1.grad.t() @ a1.grad
However, the a1.grad is different from the a_1 in (1) of kfac's paper. Specifically, when you do back…
-
### Feature
I kindly request the addition of support for the Kronecker-Factored Approximate Curvature (KFAC) optimization technique in LSTM and GRU layers within the existing KFAC Optimizer. Curren…
-
## 🚀 Feature
Add the [Kronecker-factored Approximate Curvature (KFAC)](https://arxiv.org/abs/1503.05671) optimizer and/or [E-KFAC](https://arxiv.org/abs/1806.03884).
## Motivation
These are both …
n-gao updated
3 years ago
-
from deepqmc import Molecule
mol = Molecule.from_name('LiH')
while using above command it is giving an import error
-
In compute_cov_a,
`a = a.view(-1, a.size(-1)).div_(a.size(1)).div_(a.size(2))`
should be
`a = a.view(-1, a.size(-1))`
In compute_cov_g,
`g = g.view(-1, g.size(-1)).mul_(g.size(1)).mul_(g.size…
-
If you try to install `fast-jl` or `traker[fast]` with `pip==23.3.2` or `pip==24.0`, you get the following error:
```
Collecting fast-jl==0.1.2
Using cached fast_jl-0.1.2.tar.gz (5.2 kB)
Ins…
-
In the ACKTR.pg, a KFACOptimizer is imported. But no source file is found