search

aai-institute / pyDVL

pyDVL is a library of stable implementations of algorithms for data valuation and influence function computation
https://pydvl.org
GNU Lesser General Public License v3.0
109 stars 8 forks source link

Improve the precision of DirectInfluence with second order mode Gauss Newton #594

Open janosg opened 5 months ago

janosg commented 5 months ago

As discussed in #591 it might be possible to build up the inverse of the Gauss Newton matrix directly without materializing the Gauss Newton matrix (as currently done here).

On top of a potential speedup, this could increase the precision as it avoids Sin 2 of the 7 sins of numerical linear algebra