search

pytorch / PiPPy

Pipeline Parallelism for PyTorch
BSD 3-Clause "New" or "Revised" License
726 stars 86 forks source link

Torchtitan Pipeline Parallel Issue Tracker #1103

Open wconstab opened 6 months ago

wconstab commented 6 months ago

1D

2D (FSDP)

3D (TP)