noahgolmant / pytorch-hessian-eigenthings

Efficient PyTorch Hessian eigendecomposition tools!
MIT License
360 stars 43 forks source link

Add ARPACK lanczos hook through scipy.linalg #27

Closed noahgolmant closed 5 years ago

noahgolmant commented 5 years ago

Add [scipy.sparse.linalg] hook to run Lanczos for the top k eigenvalues/eigenvectors instead of power iteration.

Solves #3.

noahgolmant commented 5 years ago

Hessian results have good eigenvalue estimates, but worse eigenvector results compared to power iteration:

lanczos