Add support of DDP and CompiledAutograd. - Githubissues

pytorch / torchtitan

A native PyTorch Library for large model training

BSD 3-Clause "New" or "Revised" License

2.29k stars 170 forks source link

Add support of DDP and CompiledAutograd. #319

Closed fegin closed 3 months ago

fegin commented 4 months ago

Stack from ghstack (oldest at bottom):

-> #319