search

lrzjason / T2ITrainer

Practice Code for text to image trainer
GNU Affero General Public License v3.0
82 stars 5 forks source link

Question: training full layers LoRA/DoRA #11

Closed lekima closed 3 months ago

lekima commented 3 months ago

Hi, I'm having a question.

OneTrainer has a feature that allows you to train all layers for a LoRA/DoRA, do we have a similar option? If not, is it something that we can consider supporting?

My understanding is that this full layer training, together with DoRA, will lead to higher quality overall.