search

hako-mikan / sd-webui-supermerger

model merge extention for stable diffusion web ui
GNU Affero General Public License v3.0
746 stars 113 forks source link

Support for Flux LoRA merge #414

Open diodiogod opened 2 weeks ago

diodiogod commented 2 weeks ago

Please, may you consider support for merging Flux LoRAs? Specially with block weights? Maybe consider supporting 19 or 57 values input for the blocks. Refer to this discussion with @nihedon https://github.com/nihedon/sd-webui-lora-block-weight/issues/2#issuecomment-2390632995

Right now the only tool I know of to merge loras is some nodes on comfyui and this: https://github.com/Anashel-RPG/anashel-utils And to save loras with modified block weights, I tried to create my own tool, but I'm not sure what is the proper target layers: https://github.com/diodiogod/Flux-Block-Weight-Remerger

I would love to be able to use supermerger again, like I did with SDXL, for flux, specially with the "same to Strength" option.

Thanks!!

duskfallcrew commented 1 week ago

There's no way to do it on A111 as there's no flux support AFAIK.

diodiogod commented 6 days ago

There's no way to do it on A111 as there's no flux support AFAIK.

I'm asking for Forge, obviously. Nihedon managed to port LBW to forge and then managed to support Flux. From what I understand, hako-mikan implemented support for Forge, but so far, the lora merging for flux don't work. I opened a ticket to so hako-mikan knows this is wanted. I hope it gets implemented! =D

duskfallcrew commented 6 days ago

There's no way to do it on A111 as there's no flux support AFAIK.

I'm asking for Forge, obviously. Nihedon managed to port LBW to forge and then managed to support Flux. From what I understand, hako-mikan implemented support for Forge, but so far, the lora merging for flux don't work. I opened a ticket to so hako-mikan knows this is wanted. I hope it gets implemented! =D

If you try the "replace pluslora.py" with the branch/tree 20's version IT MIGIHT work, but that's dependent on the fact it worked for me on a vast instance, and i'm not running forge.