[dattri.func.ihvp] Implement ihvp_at_x_ekfac - Githubissues

TRAIS-Lab / dattri

`dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.

https://trais-lab.github.io/dattri/

24 stars 8 forks source link

[dattri.func.ihvp] Implement ihvp_at_x_ekfac #79

Closed sx-liu closed 2 months ago

sx-liu commented 3 months ago

Description

1. Motivation and Context

To complete the proposal in the issue #76.

2. Summary of the change

The implementation is basically the same as originally designed.

Specifically,

Added ihvp_at_x_ekfac and its helper functions to dattri.func.ihvp.
Added wrapper function manual and class MLPCache to dattri.func.ihvp.
Slightly modified dattri.func.ihvp._check_input_size to support the EK-FAC method.

3. What tests have been added/updated for the change?

[x] Unit test: Typically, this should be included if you implemented a new function/fixed a bug.

tingwl0122 commented 3 months ago

Thanks for the PR. I will also take a look later.

jiaqima commented 3 months ago

@sleepymalc could you also take a look at this PR?