Acly / krita-ai-diffusion

Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.
https://www.interstice.cloud
GNU General Public License v3.0
6.96k stars 342 forks source link

GGUF model support #1411

Closed ricperry closed 4 days ago

ricperry commented 5 days ago

With the official FLUX and SD3.5 models being too large to work on many GPUs, and the prevalence of quantized models in .gguf format, it would be nice to support .gguf model files. This makes it necessary to specify the CLIP_L and T5XXL model paths, (specifying VAE path is already supported). Request official support for this method of running Flux and advanced SD3x models.

Acly commented 4 days ago

Flux: already supported #1176 SD3.5: doesn't work yet, but issue exists #1405