MadryLab / trak

A fast, effective data attribution method for neural networks in PyTorch
https://trak.csail.mit.edu/
MIT License
175 stars 24 forks source link

Can trak be applied to diffusion models? #37

Closed xszheng2020 closed 1 year ago

xszheng2020 commented 1 year ago

Hi, @kristian-georgiev

In the paper, you mentioned that "More broadly, attribution for generative models (e.g., stable diffusion [HJA20; RBL+22]) is an interesting direction for future work." So I am wondering whether trak can be applied to diffusion models?

Indeed, I have done some tests under the lora finetuning setting but got very low lds scores...