Closed askinucuncu closed 3 years ago
No answer on the topic?
Logs and checkpoints will be stored at outputs directory, which is located in the same directory that you run the command line Best_checkpoint path: outputs/date_time/exp_id/checkpoints/checkpoint_best.pt
It would be surprising to know that it could have been a permissions issue, especially that the folders have been created.
If you are using google collaboratory, the explorer can't show the checkpoint files. However, the files exist. You can confirm the checkpoints directory using the ls command in a cell or terminal.
Google collaboratory kullanıyorsanız, gezgin kontrol noktası dosyalarını gösteremez. Ancak dosyalar var. Bir hücre veya terminalde ls komutunu kullanarak denetim noktaları dizinini onaylayabilirsiniz.
thanks, it didn't occur to me
Hi, It says Saved but I checked the folder and it is empty.
2021-01-29 08:29:52 | INFO | fairseq.trainer | Preparing to save checkpoint to checkpoints/checkpoint_last.pt after 21 updates 2021-01-29 08:29:56 | INFO | fairseq.trainer | Finished saving checkpoint to checkpoints/checkpoint_last.pt 2021-01-29 08:29:56 | INFO | fairseq.checkpoint_utils | saved checkpoint checkpoints/checkpoint_last.pt (epoch 33 @ 21 updates, score 3.125) (writing took 4.057792565999989 seconds) 2021-01-29 08:29:56 | INFO | fairseq_cli.train | end of epoch 33 (average epoch stats below)