Pytorch DDP tutorial. Update pytorch-ddp-accelerate-transformers.md - Githubissues

huggingface / blog

Public repo for HF blog posts

https://hf.co/blog

2.3k stars 712 forks source link

Pytorch DDP tutorial. Update pytorch-ddp-accelerate-transformers.md #2338

Closed danilyef closed 3 weeks ago

danilyef commented 3 weeks ago

Correction in DDP Pytorch:

Rank instead of device
ddp_model instead of model