How much vram and speed?

omer11a / bounded-attention

MIT License

56 stars 7 forks source link

How much vram and speed? #7

Open johnwick123f opened 1 month ago

johnwick123f commented 1 month ago

Same as the title, how much vram does it take to run sdxl. How fast is it as well? Great project btw!

omer11a commented 3 weeks ago

Inference on SDXL takes around 6 minutes and requires roughly 37GB of VRAM, using the default hyper-parameters. Decreasing num_guidance_steps and/or num_gd_iterations will decrease the runtime, compromising performance.