search

bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
376 stars 49 forks source link

Create pretrain_bigbigcode.slurm #42

Closed lvwerra closed 1 year ago

loubnabnl commented 1 year ago

we can probably close this PR, added the final training script here