Nerogar / OneTrainer

OneTrainer is a one-stop solution for all your stable diffusion training needs.
GNU Affero General Public License v3.0
1.81k stars 154 forks source link

Warmup steps allows values <1 as percentage of total #558

Closed efhosci closed 2 weeks ago

efhosci commented 2 weeks ago

Changes "warmup steps" parameter from int to float. For input values >1 it behaves the same way as it did previously, warmup steps / gradient steps. For values between 0-1, it changes to warmup steps * total steps (total steps already compensates for gradient accumulation). Any other values will be set to zero. Also modified mouseover text to reflect that change.

Some examples of behavior, tested with total steps 100. Also verified warmup behavior correctly works for different gradient accumulation values, though I did come across an issue related to changing that value while training is running (see issue #557):

O-J1 commented 2 weeks ago

@efhosci Did you mean to close this?

efhosci commented 2 weeks ago

Sorry about that, I split the changes i just submitted into a different branch.