LarsKue / lightning-trainable

A default trainable module for pytorch lightning.
MIT License
10 stars 1 forks source link

Progressbar confusing when continuing training of a loaded model. #8

Closed HeiseMax closed 1 year ago

HeiseMax commented 1 year ago

When continuing to train a model loaded from a checkpoint it will train for {max_epochs - "already trained epochs"}.

Example:

Screenshot from 2023-05-30 10-34-14 The epoch counter on the left shows total trained epochs. The counter on the right shows trained epochs in the current run, but the total on the right is max_epochs although training will only be half of that.

When the training is finished the progressbar is only at the halfway line. Screenshot from 2023-05-30 11-00-41 (Sorry, different example.)

LarsKue commented 1 year ago

Reverted to the default lightning progress bar for now.