search

wayveai / Driving-with-LLMs

PyTorch implementation for the paper "Driving with LLMs: Fusing Object-Level Vector Modality for Explainable Autonomous Driving"
Apache License 2.0
446 stars 38 forks source link

How to Use Multi-GPU Training #8

Open Dylandtt opened 1 year ago

Dylandtt commented 1 year ago

How to Use Multi-GPU Training

Dylandtt commented 1 year ago

ERROR: Could not consume arg: --local-rank=1 ERROR: Could not consume arg: --local-rank=0

melights commented 9 months ago

Hi @Dylandtt, Please use WORLD_SIZE=8 python -m torch.distributed.run --nproc_per_node=8 train.py for multi-GPU training (change 8 to the number of GPUs you want to use).
If you have any further questions or need additional information, please feel free to ask.