I still dont like to set load_best_checkpoint to false everytime I need to train a new model from scratch and then set it to true once I run it one time. If I run a second time and I forgot to set load_best_checkpoint to true, it will overwrite my previous best model since it does not know the score of the previous training.
As we discussed : lets make a flag that explicitly say train from scracth.
train_from_scratch = True : never load the data
train_from_scratch = False : check if we can load, if not initialize network, else load
I still dont like to set load_best_checkpoint to false everytime I need to train a new model from scratch and then set it to true once I run it one time. If I run a second time and I forgot to set load_best_checkpoint to true, it will overwrite my previous best model since it does not know the score of the previous training.