search

LaurentMazare / diffusers-rs

An implementation of the diffusers api in Rust
Apache License 2.0
521 stars 54 forks source link

Integration with Stable Diffusion XL 1.0 ? #78

Closed Cyril-Cf closed 11 months ago

Cyril-Cf commented 11 months ago

Hello,

That might be a silly question, but will there be future integrations with SDXL in a near future? It seems to me that the XL version is pretty different so I figured we couldn't use it as is.

Thanks for your help!

LaurentMazare commented 11 months ago

Actually if you exclude the refiner net, sdxl is pretty close to earlier versions of stable diffusion - the only difference being on the tokenization side (using two tokenizers rather than one). You can see here the pull request that added it to candle. I don't think it would be that much effort to support, though I would recommend giving a spin to the candle version, and note that candle also supports wuerstchen for image generation.