I am using AllenNLP-2.4.0.
I trained my model for 11 epochs. When I tried to compare different checkpoints of my model, I found that some checkpoints are missing:
You can see only model_state_epoch 0, 1, 9 and 10 are there, while all other epochs are missing. I also observed something similar in my other jobs. I didn't delete any files manually. I used AllenNLP-0.9.0 before and have never run into similar situations. Is this a new feature or a bug? Any response will be greatly appreciated.
Hi,
I am using
AllenNLP-2.4.0
. I trained my model for 11 epochs. When I tried to compare different checkpoints of my model, I found that some checkpoints are missing:You can see only
model_state_epoch
0, 1, 9 and 10 are there, while all other epochs are missing. I also observed something similar in my other jobs. I didn't delete any files manually. I usedAllenNLP-0.9.0
before and have never run into similar situations. Is this a new feature or a bug? Any response will be greatly appreciated.