The current version of the program only saves the final weight, which can be inconvenient if the training is interrupted in the middle, and there's a need to resume training from a specific point.
Is there a way to save intermediate weights at fixed iterations during training, allowing us to resume training from those checkpoints if needed?
The current version of the program only saves the final weight, which can be inconvenient if the training is interrupted in the middle, and there's a need to resume training from a specific point.
Is there a way to save intermediate weights at fixed iterations during training, allowing us to resume training from those checkpoints if needed?