noahgolmant pytorch-hessian-eigenthings issues

noahgolmant / pytorch-hessian-eigenthings

Efficient PyTorch Hessian eigendecomposition tools!

MIT License

360 stars 43 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Add MPS support

#43 tim-lawson closed 8 months ago
0
Eigenvalue and eigenvector deviation with GPU hardware

#42 AjinkyaBankar opened 3 years ago
2
ValueError: PENet on the Kitti benchmark suite

#41 AjinkyaBankar opened 3 years ago
1
Add black/pep8 reformatting; add type-hinting and comments; update wishart/regression tests

#40 noahgolmant closed 3 years ago
0
Python Error: the following arguments are required: experimentname

#39 AjinkyaBankar closed 3 years ago
1
AttributeError: 'HVPOperator' object has no attribute 'zero_grad'

#38 neerajkuhike closed 3 years ago
2
Implementation of prepare_grad and apply

#37 oliu-io closed 3 years ago
3
Stochastic lanczos quadrature

#36 devansh20la opened 3 years ago
0
Add FP16 support for low-precision HVP gradient math, power iteration, and Lanczos

#35 noahgolmant closed 3 years ago
0
Add fp16 support for half-precision power iteration and lanczos

#34 noahgolmant closed 3 years ago
0
Add Colab notebook example to analyze Huggingface model

#33 noahgolmant opened 3 years ago
0
Add DistributedDataParallel and MPI Integration

#32 noahgolmant opened 3 years ago
0
Add spectral density computation using lanczos vectors

#31 noahgolmant opened 3 years ago
2
RuntimeError: One of the differentiated Tensors appears to not have been used in the graph.

#30 imirzadeh closed 4 years ago
2
Add principal eigenvector accuracy tests

#29 noahgolmant closed 5 years ago
0
add shortcut to evaluate hessian over full dataset

#28 noahgolmant closed 5 years ago
0
Add ARPACK lanczos hook through scipy.linalg

#27 noahgolmant closed 5 years ago
1
Add power iteration accuracy tests with minor stability fixes for power iteration

#26 noahgolmant closed 5 years ago
0
Difficulty using in Colabs.

#25 xaviergonzalez closed 5 years ago
2
setup.py does not work on OSX

#24 themightyoarfish closed 5 years ago
2
Test eigenvalue stability and alternative variance reduction techniques

#23 noahgolmant closed 5 years ago
4
tests power iteration methods by comparing against np.linalg.eig results

#22 Tron-x closed 5 years ago
17
the power_iteration to compute the dominant eigenvalue/eigenvector

#21 Tron-x closed 5 years ago
1
which epoch or iteration time point to compute tok-n eigenvalue ,eigenvector?

#20 Tron-x closed 5 years ago
1
Hessian for multilayer network

#19 gudovskiy closed 5 years ago
1
Create hessian tests on small networks, measure convergence vs hyperparameters

#18 noahgolmant closed 4 years ago
2
Hessian computation is very sensitive to `power_iter_steps`

#17 themightyoarfish closed 4 years ago
5
Set default power-iter-steps in Tracker init

#16 themightyoarfish closed 5 years ago
1
Missing property in HessianTracker

#15 themightyoarfish closed 5 years ago
0
Compute the most negative eigenvalues with power iteration (untested)

#14 noahgolmant opened 5 years ago
0
[Help wanted] How can I feed in precomputed gradients?

#13 themightyoarfish closed 5 years ago
3
add testing for deflated power iteration with random matrices

#12 noahgolmant closed 5 years ago
0
Computing the smallest eigenpairs

#11 themightyoarfish closed 3 years ago
6
Add utility to track the Hessian throughout training (WIP)

#10 noahgolmant opened 5 years ago
0
Fix eigenvalue to be a float instead of a tensor during power iteration

#9 noahgolmant closed 5 years ago
0
Power iter fails with cuda tensor

#8 themightyoarfish closed 5 years ago
3
Add continuous Hessian spectrum throughout training

#7 noahgolmant opened 5 years ago
3
Adds support for larger batch sizes for lower variance.

#6 noahgolmant closed 5 years ago
0
Add accleration via momentum

#5 noahgolmant closed 5 years ago
0
Add option to use multiple batches for a single step of power iteration

#4 noahgolmant closed 5 years ago
4
Add hook to scipy Lanczos implementation

#3 noahgolmant closed 5 years ago
0
Add basic tests with numpy

#2 noahgolmant closed 5 years ago
0
Implement accelerated stochastic power iteration

#1 noahgolmant closed 5 years ago
1