facebookresearch / fairseq

Facebook AI Research Sequence-to-Sequence Toolkit written in Python.
MIT License
30.57k stars 6.41k forks source link

Is NCCL really necessary for single-GPU training? #5524

Open Geremia opened 4 months ago

Geremia commented 4 months ago

The readme says:

For training new models, you'll also need an NVIDIA GPU and NCCL

NCCL is "Optimized primitives for collective multi-GPU communication ". I only have one GPU. Can I build pip install --user --editable ./ without NCCL support?