search

LostRuins / koboldcpp

A simple one-file way to run various GGML and GGUF models with KoboldAI's UI
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
4.36k stars 312 forks source link

found a sdxl lightning gguf repo that works #796

Open teddybear082 opened 2 months ago

teddybear082 commented 2 months ago

for those looking I stumbled upon this sdxl lightning gguf repo that works with koboldcpp (in lite interface cfg_scale = 1, steps = 4, sampler LCM)

maybe this could be added to wiki if others validate it works for them. I tried with q4_1, was much faster than regular sdxl.

https://huggingface.co/mzwing/SDXL-Lightning-GGUF/tree/main

EDIT: the LCM sampler seems to do really well with this, and 4 steps with cfg_scale =1 seems perfect. Here's an example image for the prompt "a man with a hat": image

LostRuins commented 2 months ago

That's neat. Is it the base model or a finetuned one?

teddybear082 commented 2 months ago

I think it's based off of https://huggingface.co/ByteDance/SDXL-Lightning but has the vae included.

LostRuins commented 2 months ago

Awesome.

schorhr commented 1 month ago

Awesome, any chance sdxs-512-0.9 or hypersd-sd1-5-1-step could work? I can't get them to run.

LostRuins commented 1 month ago

Can you link to the safetensors in question so I can take a look?

schorhr commented 1 month ago

Yes, of course :-)

https://huggingface.co/IDKiro/sdxs-512-dreamshaper/tree/main (was ~https://huggingface.co/IDKiro/sdxs-512-0.9/tree/main~, links to sdxs-512-dreamshaper now)

https://huggingface.co/rupeshs/hypersd-sd1-5-1-step-lora/tree/main Thanks for looking into it.

teddybear082 commented 1 month ago

https://huggingface.co/rupeshs/hypersd-sd1-5-1-step-lora/tree/main Thanks for looking into it.

That one looks like it's just a lora not a full model.

LostRuins commented 1 month ago

Yeah, the model that you have linked is not in a format you can use. You need the packed version, which includes clip tokenizer, unet, and vae, usually its a 2.3GB safetensors file for SD1.5

Also, that seems to be a "SDXS" model, which I'm not sure is actually compatible.

If you're looking for dreamshaper, may I suggest this: https://civitai.com/models/112902/dreamshaper-xl

LostRuins commented 1 month ago

Hi, Custom LORA, TAESD and custom VAE are now supported in the latest version. This can help fix any models with broken VAEs