search

NVIDIA / Megatron-LM

Ongoing research training transformer models at scale
https://docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start
Other
10.13k stars 2.28k forks source link

[Bugfix] Fix typo in moe doc #986

Open billishyahao opened 1 month ago

billishyahao commented 1 month ago

This minor patch is to fix typo in moe introduction document.

yaox12 commented 3 weeks ago

Good catch. Fixed in https://github.com/NVIDIA/Megatron-LM/commit/e223b920724c523a098558b2c128b4d6eb7f8ff0.