add support of resuming shard positions and saving in ckpt.

facebookresearch / MetaCLIP

ICLR2024 Spotlight: curation/training code, metadata, distribution and pre-trained models for MetaCLIP; CVPR 2024: MoDE: CLIP Data Experts via Clustering

Other

1.27k stars 54 forks source link

add support of resuming shard positions and saving in ckpt. #66

Closed howardhsu closed 2 months ago

howardhsu commented 2 months ago

lgtm.