search

NVIDIA / Megatron-LM

Ongoing research training transformer models at scale
https://docs.nvidia.com/megatron-core/developer-guide/latest/user-guide/index.html#quick-start
Other
9.23k stars 2.08k forks source link

[QUESTION] Does Megatron-LM supports P100? #849

Open gaokaiz2 opened 1 month ago

gaokaiz2 commented 1 month ago

Does Megatron-LM supports P100? I heard that due to different hardware architecture it may not, but I haven't found direct evidence.

deepakn94 commented 3 weeks ago

It should, though we haven't tested it on P100s in years, and a few bugfixes might be required,

Edenzzzz commented 1 day ago

Would be useful for a museum demo