LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.33k stars 363 forks source link

Add different schedulers for image generation #1125

Open Circl3s opened 2 months ago

Circl3s commented 2 months ago

I know image gen isn't the main focus of KoboldCPP, but it's the easiest way for a noob (like me) to run Stable Diffusion locally. I noticed a lot of SD models want you to use specific schedule types (mainly Karras or exponential) or recommend experimenting with different ones, and stable-diffusion.cpp already supports it. Adding this along with removing the 1024px limit (why is it even there?) would be very useful. Either way, thanks for this amazing tool. :)

LostRuins commented 2 months ago

1024px limit was set as the image generation was not stable at higher values, often crashing the server or going out of memory.

As for the scheduler, it's technically possible but its currently a load-time parameter and not handled over the API, so that would need some time and effort to add in.

Have you see the options within the Lite UI under the "Media" tab? image