search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

Add data loading time in log #154

Open XinDongol opened 5 months ago

XinDongol commented 5 months ago

It will be very helpful to have data loading time in log to understand the bottleneck