rohitgandikota / erasing

Erasing Concepts from Diffusion Models
https://erasing.baulab.info
MIT License
559 stars 34 forks source link

Replacing concepts with existing ones #24

Open GumGum10 opened 10 months ago

GumGum10 commented 10 months ago

Hi,

Thank you so much for your work! It is very insightful how this was thought out and I appreciate all the work. I'm currently researching ways to change a diffusion model besides the classic ones. I was wondering, would it be possible, given how we are erasing concepts from the model here, to actually replace the concepts we delete with ones already existing in the model?

Thanks, Ly

rohitgandikota commented 10 months ago

Hi Ly,

I'm glad you enjoyed the work. There are some follow-up and concurrent works that explored this direction.

For example:

  1. UCE: Unified Concept Editing in Diffusion Models. https://unified.baulab.info/ (let's you rewrite a concept with a different one)

  2. Concept Ablation https://www.cs.cmu.edu/~concept-ablation/ (let's you modify the distribution to an anchor concept)

There are some more that explored this direction.