Enable rocm-support - Githubissues

bigscience-workshop / Megatron-DeepSpeed

Ongoing research training transformer language models at scale, including: BERT & GPT-2

Other

1.31k stars 213 forks source link

Open luukkonenr opened 1 year ago

luukkonenr commented 1 year ago

Patch rocm-support to fused kernels from Microsoft/Megatron-DeepSpeed-fork.