pytorch / torchdistx

Torch Distributed Experimental
BSD 3-Clause "New" or "Revised" License
116 stars 31 forks source link

Documentation for AnyPrecisionOptimizer #61

Open rohan-varma opened 2 years ago

rohan-varma commented 2 years ago

As @stas00 mentions, AnyPrecisionOptimizer documentation should exist here: https://pytorch.org/torchdistx/latest/, otherwise users will not be aware of new features and may not try them out.

lessw2020 commented 2 years ago

Happy to work on this (actually had started a doc this weekend). Thanks for adding the tracking issue @rohan-varma and for the feedback @stas00!

lxuechen commented 1 year ago

Are there any updates on this issue? @lessw2020 @stas00 @rohan-varma

lessw2020 commented 1 year ago

@lxuechen - thanks for the reminder here. We have been using AnyPrecision, so let's see about getting it into TorchMM for a home and then can also add documentation. Will provide an update this week.