add config option to only produce tensorboard logs on rank 0 - Githubissues

pytorch / torchtitan

A native PyTorch Library for large model training

BSD 3-Clause "New" or "Revised" License

1.29k stars 115 forks source link

add config option to only produce tensorboard logs on rank 0 #304

Closed tianyu-l closed 1 month ago