Checkpointing on multiple nodes

facebookresearch / moco

PyTorch implementation of MoCo: https://arxiv.org/abs/1911.05722

MIT License

4.83k stars 794 forks source link

Open yoavmiron98 opened 3 years ago

yoavmiron98 commented 3 years ago

It seems that save_checkpoint runs on one process per node (line 270 in main_moco.py). Shouldn't it run only in one process?