[ADD] `SqrtGGN{Exact,MC} support for ResNet modules

f-dangel / backpack

BackPACK - a backpropagation package built on top of PyTorch which efficiently computes quantities other than the gradient.

https://backpack.pt/

MIT License

555 stars 55 forks source link

Closed f-dangel closed 2 years ago

f-dangel commented 2 years ago

Support includes SumModule, ScaleModule, and Identity. Fix incorrect detection of reduction factor in the tests if batch_size=1.