TRAIS-Lab / dattri

`dattri` is a PyTorch library for developing, benchmarking, and deploying efficient data attribution algorithms.
https://trais-lab.github.io/dattri/
24 stars 8 forks source link

Partial parameter selection for slow algs #91

Open tingwl0122 opened 2 months ago

tingwl0122 commented 2 months ago

Although most of our algorithms can accept partial model parameters as input, we can help users by possibly automatically doing this.

Justification: For example, TRAK reports that it is only feasible to run most of their tests on the final layer parameters for the IF family. We also observe super slow speed for IF family on Cifar-2 size tast.

tingwl0122 commented 2 months ago

Add additional benchmark experiments based on last layer parameters