CompVis / stable-diffusion

A latent text-to-image diffusion model
https://ommer-lab.com/research/latent-diffusion-models/
Other
66.54k stars 9.97k forks source link

[Documentation] Flash Attention 2.0 #765

Open ternaus opened 11 months ago

ternaus commented 11 months ago

It looks like Flash attention 2.0 brings solid improvements over 1.0.

It would be great to see an example of how one can leverage it in Stable Diffusion:

https://github.com/Dao-AILab/flash-attention