TRAIS-Lab / dattri

`dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
https://trais-lab.github.io/dattri/
MIT License
28 stars 8 forks source link

[dattri.func.ihvp] Add Arnoldi as another ihvp method #33

Closed tingwl0122 closed 4 months ago

tingwl0122 commented 4 months ago

Description

Add one more ihvp method: Arnoldi that uses Arnoldi Iteration.

1. Motivation and Context

2. Summary of the change

3. What tests have been added/updated for the change?

tingwl0122 commented 4 months ago

Will add regularization to the function soon.

tingwl0122 commented 4 months ago

Hi @TheaperDeng , Regularization option added, should be good to merge.

jiaqima commented 4 months ago

@sleepymalc please take a look at the algorithm logic.

tingwl0122 commented 4 months ago

Just to give a bit more context, I follow the official implementation logic (it was written in JAX) and re-write it into PyTorch. (https://github.com/google-research/jax-influence/blob/main/jax_influence/arnoldi.py)