Nerogar / OneTrainer

OneTrainer is a one-stop solution for all your stable diffusion training needs.
GNU Affero General Public License v3.0
1.34k stars 110 forks source link

Update the default module filter for PixArt Sigma lora. #356

Open mx opened 1 week ago

mx commented 1 week ago

Folks were dissatisfied with lora training compared to finetunes. This will add the MLP layers to the training.

This is a stopgap measure until the lora refactor with presets comes online (this will be the "attention-mlp" preset, with the former being "attention-only").