search

deel-ai / influenciae

👋 Influenciae is a Tensorflow Toolbox for Influence Functions
https://deel-ai.github.io/influenciae
Other
55 stars 3 forks source link

Conjugate Gradients Inverse-Hessian-Vector-Products #7

Closed Agustin-Picard closed 2 years ago

Agustin-Picard commented 2 years ago

This PR introduces the approximate computation of inverse-hessian-vector-products, useful for calculating influence vectors and values. By using forward-over-backward autodiff combined with a conjugate gradients solver, we are able to compute these quantities without the need for storing or inverting the hessian matrix.

Agustin-Picard commented 2 years ago

I cleared some conflicts that appeared after rebasing on to the first-order branch