Closed TJKlein closed 2 years ago
If one is not careful and forgets to set argument
---load_best_model_at_end
the model obtained by model selection will be overwritten by 'current' model, directly after the training step
https://github.com/princeton-nlp/SimCSE/blob/30b08875a39d0e89d71f17c57bd0dcc18e7c2f15/train.py#L550
As saving the model after the training is just there to store the tokenizer, I recommend moving it up before the train step:
https://github.com/princeton-nlp/SimCSE/blob/30b08875a39d0e89d71f17c57bd0dcc18e7c2f15/train.py#L549
If one is not careful and forgets to set argument
the model obtained by model selection will be overwritten by 'current' model, directly after the training step
As saving the model after the training is just there to store the tokenizer, I recommend moving it up before the train step: