search

LostRuins / koboldcpp

Run GGUF models easily with a KoboldAI UI. One File. Zero Install.
https://github.com/lostruins/koboldcpp
GNU Affero General Public License v3.0
5.35k stars 363 forks source link

Ability to load multiple LoRA for SD Image Generation #1181

Closed guxanan closed 1 month ago

guxanan commented 1 month ago

Describe the Issue There are a variety of LoRA for different purposes, such as better image generation with much fewer needed steps like SDXL-Lightning, different art styles, scene compositions, characters.

Being able to load only one is very limiting, even more so for those with weaker hardware who want to try various models in combination with SDXL-Lightning with other LoRA, so it would be amazing to have this feature available.

Usecase

Additional Information:

LostRuins commented 1 month ago

Have you considered merging some of them together?

guxanan commented 1 month ago

Have you considered merging some of them together?

If koboldcpp provides a script for it, I didn't know. I would like it if you could kindly pointed me to some resources for that as I'm still quite new to this.

Using such a method wouldn't be a great solution though. For example, quickly changing between weights/strength for different LoRA wouldn't be possible and you'd have to make multiple merges with different weights and keep them all on disk, which would increase space usage substantially.

I'm not aware of how speedy such a process would be on weaker hardware either, and my hardware barely qualifies as low-end at this point.

I'm sorry if this is a big task to ask for, I would love for this feature to be implemented, but I understand if you don't want to do it.

LostRuins commented 1 month ago

Yeah unfortunately for the moment I think only a single lora is supported.

guxanan commented 1 month ago

Unfortunate but understandable, should this issue be closed or remain open?

LostRuins commented 1 month ago

I'll close it for now, may be revisited in future