microsoft / Olive

Olive: Simplify ML Model Finetuning, Conversion, Quantization, and Optimization for CPUs, GPUs and NPUs.
https://microsoft.github.io/Olive/
MIT License
1.62k stars 172 forks source link

[FR]: Add support for Stable Diffusion 3 on DirectML #1251

Open thevishalagarwal opened 4 months ago

thevishalagarwal commented 4 months ago

Proposal Summary

Is there any plan to add support for Stable Diffusion 3 for DirectML?

What component(s) does this request affect?

Jay19751103 commented 3 months ago

Hi Olive Team

Does SD3 be included olive optimization process. I tried this by sdxl opt script. It cannot fuse any MHA. MHA have different with previous.

peterer0625 commented 1 month ago

Is there a plan?