[RFC] Allow ModelWrapper and OptimizerWrapper to accept multiple models - Githubissues

pytorch / torchtitan

A native PyTorch Library for large model training

BSD 3-Clause "New" or "Revised" License

1.28k stars 115 forks source link

[RFC] Allow ModelWrapper and OptimizerWrapper to accept multiple models #360

Closed fegin closed 3 weeks ago

fegin commented 1 month ago

Stack from ghstack (oldest at bottom):

-> #360