leejet / stable-diffusion.cpp

Stable Diffusion in pure C/C++
MIT License
2.94k stars 238 forks source link

add support for StableCascade (würstchen) #176

Open Green-Sky opened 5 months ago

Green-Sky commented 5 months ago

StableCascade (würstchen)

blog: https://stability.ai/news/introducing-stable-cascade gh: https://github.com/Stability-AI/StableCascade hf: https://huggingface.co/stabilityai/stable-cascade

This model is built upon the Würstchen architecture and its main difference to other models, like Stable Diffusion, is that it is working at a much smaller latent space. Why is this important? The smaller the latent space, the faster you can run inference and the cheaper the training becomes. How small is the latent space? Stable Diffusion uses a compression factor of 8, resulting in a 1024x1024 image being encoded to 128x128. Stable Cascade achieves a compression factor of 42, meaning that it is possible to encode a 1024x1024 image to 24x24, while maintaining crisp reconstructions. The text-conditional model is then trained in the highly compressed latent space. Previous versions of this architecture, achieved a 16x cost reduction over Stable Diffusion 1.5.

image

scientism commented 5 months ago

So far they haven't released the weights under an open license. It's non-commercial.

leejet commented 4 months ago

Work in progress!