facebookresearch / esm

Evolutionary Scale Modeling (esm): Pretrained language models for proteins
MIT License
3.16k stars 627 forks source link

ESM-2 Model checkpoints during training run #453

Closed tomsercu closed 1 year ago

tomsercu commented 1 year ago

Some folks requested intermediate checkpoints of ESM-2 during the training run. They were made available for every 50k training steps but with higher density at the start of training: 10k, 20k, 30k, 40k, 50k, 100k, 150k, etc.

https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_10000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_20000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_30000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_40000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_50000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_100000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_150000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_200000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_250000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_300000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_350000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_400000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_450000.pt
https://dl.fbaipublicfiles.com/fair-esm/models/esm2_t33_650M_UR50D_checkpoint_500000.pt