search

pytorch / PiPPy

Pipeline Parallelism for PyTorch
BSD 3-Clause "New" or "Revised" License
726 stars 86 forks source link

Refactor HuggingFace examples to use torch.distributed.pipelining #1116

Closed kwen2501 closed 6 months ago

kwen2501 commented 6 months ago

now that the pippy library has been migrated to torch.distributed.pipelining.

Next step we will use these examples in this repo as nightly CI against torch.