Adaptation of the merging method described in the paper - Git Re-Basin: Merging Models modulo Permutation Symmetries (https://arxiv.org/abs/2209.04836) for Stable Diffusion
From the paper, I see Algorithm 1 and 2 are implemented. Using scipy for the SOLVELAP look nice to me.
However in the bottom session, there is one more algorithm called "MERGEMANY", it iterlates for each model in a OVR manner, for a large model pool (paper is around 10).
Looks like it requires a new codebase to archieve this?
I think TIES is a lot more simple in this situation
From the paper, I see Algorithm 1 and 2 are implemented. Using
scipyfor the SOLVELAP look nice to me. However in the bottom session, there is one more algorithm called "MERGEMANY", it iterlates for each model in a OVR manner, for a large model pool (paper is around 10). Looks like it requires a new codebase to archieve this?I think TIES is a lot more simple in this situation