search

mlcommons / training

Reference implementations of MLPerf™ training benchmarks
https://mlcommons.org/en/groups/training
Apache License 2.0
1.6k stars 553 forks source link

[LLM] NVIDIA Megatron reference #562

Closed ShriyaPalsamudram closed 1 year ago

ShriyaPalsamudram commented 2 years ago

Here is the initial draft of Nvidia's Pytorch LLM reference

github-actions[bot] commented 2 years ago

MLCommons CLA bot All contributors have signed the MLCommons CLA ✍️ ✅

johntran-nv commented 1 year ago

@anmolgupt could you please go sign the CLA? Since your company has signed, your individual approval should be fast. https://mlcommons.org/en/get-involved/

johntran-nv commented 1 year ago

@sgpyc and others, is anything blocking before we merge this? Perhaps we can merge so people can get started and we can correct any issues later?

ShriyaPalsamudram commented 1 year ago

@sgpyc - can this be merged?