huggingface / nanotron

Minimalistic large language model 3D-parallelism training
Apache License 2.0
1.14k stars 107 forks source link

bugfix bad condition #109

Closed jordane95 closed 6 months ago

jordane95 commented 6 months ago

This line raises error when debugging before set rank for PipelineBlock. The logic here is flawed because both True and False are not None.

xrsrke commented 6 months ago

Thanks for the fix!