huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.23k stars 122 forks source link

Add time recorder #4

Closed xrsrke closed 9 months ago

xrsrke commented 10 months ago

@NouamaneTazi we already have time recorder like throughput... this is duplication right?

obrienwrite commented 9 months ago

Yes

On Wed, Jan 24, 2024, 5:57 PM XλRI-U5 @.***> wrote:

Closed #4 https://github.com/huggingface/nanotron/pull/4.

— Reply to this email directly, view it on GitHub https://github.com/huggingface/nanotron/pull/4#event-11591576210, or unsubscribe https://github.com/notifications/unsubscribe-auth/ADAN35MWYMRMV4ROOT5CN63YQG3W7AVCNFSM6AAAAABAZD5U36VHI2DSMVQWIX3LMV45UABCJFZXG5LFIV3GK3TUJZXXI2LGNFRWC5DJN5XDWMJRGU4TCNJXGYZDCMA . You are receiving this because you are subscribed to this thread.Message ID: @.***>