search

LaurentMazare / diffusers-rs

An implementation of the diffusers api in Rust
Apache License 2.0
539 stars 55 forks source link

Integration with Stable Diffusion XL 1.0 ? #78

Closed Cyril-Cf closed 1 year ago

Cyril-Cf commented 1 year ago

Hello,

That might be a silly question, but will there be future integrations with SDXL in a near future? It seems to me that the XL version is pretty different so I figured we couldn't use it as is.

Thanks for your help!

LaurentMazare commented 1 year ago

Actually if you exclude the refiner net, sdxl is pretty close to earlier versions of stable diffusion - the only difference being on the tokenization side (using two tokenizers rather than one). You can see here the pull request that added it to candle. I don't think it would be that much effort to support, though I would recommend giving a spin to the candle version, and note that candle also supports wuerstchen for image generation.