Can u plz give some idea about resuming training if interrupted in between

Rubics-Xuan / TransBTS

This repo provides the official code for : 1) TransBTS: Multimodal Brain Tumor Segmentation Using Transformer (https://arxiv.org/abs/2103.04430) , accepted by MICCAI2021. 2) TransBTSV2: Towards Better and More Efficient Volumetric Segmentation of Medical Images(https://arxiv.org/abs/2201.12785).

Apache License 2.0

386 stars 81 forks source link

Can u plz give some idea about resuming training if interrupted in between #21

Closed gjkaur closed 3 years ago

gjkaur commented 3 years ago

Hello wenxuan. I hope you recognize me. I had raised an issue earlier about predictions on brats 2020 data. I need your help in resuming the training. I am training model on google colab which shuts after 12 hours. So I want to resume it from the same point where it gets stopped.

Rubics-Xuan commented 3 years ago

Hi,gjkaur,I remebered you,bro. Our training code already achieves the goal of resuming the training. To save the model weight of the intermediate process, all you have to do is adjusting this parameter ('--save_freq', default=1000, type=int).