search

pytorch / PiPPy

Pipeline Parallelism for PyTorch
BSD 3-Clause "New" or "Revised" License
726 stars 86 forks source link

ModuleNotFoundError: No module named 'torch.distributed.pipelining'. #1131

Closed sunkun1997 closed 4 months ago

sunkun1997 commented 4 months ago

I install torch+cu121 by pip3 install torch torchvision torchaudio. When I try to run llama example, It raise ModuleNotFoundError: No module named 'torch.distributed.pipelining'. How to slove this problem? Thank you

sunkun1997 commented 4 months ago

I have known the reason, torch-2.3.1 has no module torch.distributed.pipelining, I should install the newest torch