search

mkshing / ziplora-pytorch

Implementation of "ZipLoRA: Any Subject in Any Style by Effectively Merging LoRAs"
MIT License
481 stars 33 forks source link

enforce the orthogonality between rows or columns? #22

Open yantingxu opened 6 months ago

yantingxu commented 6 months ago

It seems that by introducing merger coefficient vectors, the orthogonality between rows of LoRA weights is enforced, instead of columns?