search

f-dangel / backpack

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.
https://backpack.pt/
MIT License
555 stars 55 forks source link

[FIX] Use batch size 1 in KFAC ResNet tests #265

Closed f-dangel closed 1 year ago

f-dangel commented 1 year ago

By accident, they used batch size 3. Surprisingly, this was not caught by the test. The KFAC approximation was accurate enough for three samples.