How to continue training from a saved checkpoint

bytedance / neurst

Neural end-to-end Speech Translation Toolkit

Other

298 stars 45 forks source link

How to continue training from a saved checkpoint #59

Closed HildaNya closed 2 years ago

HildaNya commented 2 years ago

Hi. I have limited walltime for GPU usage so I can only train a certain amount of steps each time. I'd like to continue training from the last saved checkpoint, so I can get a greater number of training steps. Is there a way to configure the training to start from a certain step?

Thanks!

zhaocq-nlp commented 2 years ago

Just use the save model_dir: in your configuration file or the same --model_dir option.

HildaNya commented 2 years ago

Thank you.