How to train a model with pippy

pytorch / PiPPy

Pipeline Parallelism for PyTorch

BSD 3-Clause "New" or "Revised" License

726 stars 86 forks source link

How to train a model with pippy #1142

Open sunkun1997 opened 2 months ago

sunkun1997 commented 2 months ago

It seems that the examples here are all examples of inference, where are the examples of training？

zxmeng98 commented 1 month ago

I also have this confusion. All given examples seem to lack model parameters update step. They only contain on iteration forward and backward steps. Can someone provide the complete training examples?