search

SusungHong / Self-Attention-Guidance

The implementation of the paper "Improving Sample Quality of Diffusion Models Using Self-Attention Guidance" (ICCV`23)
MIT License
105 stars 14 forks source link

about sample process #3

Open Steven-Xiong opened 1 year ago

Steven-Xiong commented 1 year ago

Hello, thanks for your good work! I notice that you use DDPM in the code, which is slower than DDIM. I am curious is it possible to use the DDIM sample and add self attention mask to the DDIM process? Thanks

SusungHong commented 1 year ago

Hi, apologies for the delayed response.

Yes, it's possible to use the DDIM sampler with a few straightforward changes. I'll be working on this, but it might take some time. Alternatively, you could use the diffuser's implementation, which supports Stable Diffusion and any scheduler.

Thanks for your interest!

SusungHong commented 1 year ago

As a quick update, you can now use SAG with DDIM sampler in this repo. For usage, please refer to the updated README!

jweihe commented 1 year ago

Very nice work! Can SAG be used for EulerDiscreteScheduler? It seems that the implementation with diffusers still doesn't work properly with Euler sampler