search

huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.23k stars 122 forks source link

[Unit Test] Add unit tests for DistributedTrainer #90

Open xrsrke opened 8 months ago

ashishpetwal commented 8 months ago

I would like to contribute to this issue. Could you specify more about it?

xrsrke commented 8 months ago

@ashishpetwal like writing a unit test for https://github.com/huggingface/nanotron/blob/9f117eeb1e8309c45e2b1820069292ed5d7c4647/run_train.py#L136-L140

xrsrke commented 8 months ago

@ashishpetwal would you like to take it?

ashishpetwal commented 8 months ago

I haven't written tests in Python, but if it is beginner-friendly. I would love to take it. What do you think, is there a more learning curve?

xrsrke commented 8 months ago

we use pytest in nanotron https://github.com/pytest-dev/pytest