Adds support for larger batch sizes for lower variance.

noahgolmant / pytorch-hessian-eigenthings

Efficient PyTorch Hessian eigendecomposition tools!

MIT License

360 stars 43 forks source link

Adds support for larger batch sizes for lower variance. #6

Closed noahgolmant closed 5 years ago

noahgolmant commented 5 years ago

Lets you chunk up a very large batch into chunks that can fit on your GPUs. This way you can do things like approach the behavior of vanilla power iteration. Resolves #4.