search

f-dangel / vivit

[TMLR 2022] Curvature access through the generalized Gauss-Newton's low-rank structure: Eigenvalues, eigenvectors, directional derivatives & Newton steps
https://openreview.net/pdf?id=DzJ7JfPXkE
MIT License
17 stars 1 forks source link

Calculate Parameter Space Values of GGN Eigenvectors #25

Open lk-wq opened 2 years ago

lk-wq commented 2 years ago

The docs show how to calculate the gram matrix eigenvectors and the paper articulates that to translate from 'gram space' to parameter space we just need to multiply by the 'V' matrix.

What's the easiest way of implementing this?

f-dangel commented 2 years ago

Hi, thanks for your question!

I assume you are interested in the GGN eigenvectors in parameter space, and not directly in the multiplication by V. The documentation has an example how to compute eigenvalues and eigenvectors (in parameter space) via vivit's EighComputation feature.

Hope this is helpful.

Best, Felix