search

bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
373 stars 48 forks source link

Create pretrain_bigbigcode.slurm #42

Closed lvwerra closed 1 year ago

loubnabnl commented 1 year ago

we can probably close this PR, added the final training script here