support merge/export loras/lycoris - Githubissues

wkpark / sd-webui-model-mixer

Checkpoint model mixer/merger extension

GNU Affero General Public License v3.0

98 stars 4 forks source link

support merge/export loras/lycoris #51

Closed wkpark closed 8 months ago

wkpark commented 8 months ago

initial LoRA/LyCORIS merge/save+export support added

based on the following works
- kohya_ss - the original source : https://github.com/kohya-ss/sd-scripts - Apache-2.0 license
- kohya_ss + ui fix + alpha : https://github.com/bmaltais/kohya_ss
- https://github.com/KohakuBlueleaf/LyCORIS - Apache-2.0 license
- the original LoRA svd source code - https://github.com/cloneofsimo/lora - Apache-2.0 license

dynamic loading using importlib for easy develop (fix any scripts/kohya/*.py it will take effect immediately without restarting sd-webui.

[x] LyCORIS + SDXL fix
[x] LoRA support (support SD1.5, SD2.1(not fully tested), SDXL)
[x] auto detect SD1.5/SD2.1 and SDXL
[x] more verbose tqdm descriptions

⚠️ LoRA/LyCORIS export/save times are tolerable, but SDXL LoRA/LyCORIS save/export times are very slow and demand too much RAM with high CPU load.

⚠️ using cuda much faster than using CPU (about ~4 times faster 👀)