search

bigcode-project / Megatron-LM

Ongoing research training transformer models at scale
Other
371 stars 48 forks source link

add token/s/gpu to wandb #43

Closed lvwerra closed 1 year ago

lvwerra commented 1 year ago

Adds tokens per second and gpu as a metric to the W&B logs.