minor : number of gpu:s per node is not always 8

huggingface / nanotron

Minimalistic large language model 3D-parallelism training

Apache License 2.0

1.14k stars 107 forks source link

Closed staghado closed 5 months ago

staghado commented 5 months ago

Get number of GPU:s per node using device_count() instead of hardcoding it.