Hello! I've found bug with checkpointing in your code which leads to that only best checkpoints is getting saved. This happens because if CHECKPOINT_INTERVAL = VALIDATION_INTERVAL (default case), then if global_step % VALIDATION_INTERVAL == 0 and if global_step % CHECKPOINT_INTERVAL never evaluates to True.
This pull request fixes this.
Hello! I've found bug with checkpointing in your code which leads to that only best checkpoints is getting saved. This happens because if CHECKPOINT_INTERVAL = VALIDATION_INTERVAL (default case), then
if global_step % VALIDATION_INTERVAL == 0 and if global_step % CHECKPOINT_INTERVAL
never evaluates to True. This pull request fixes this.