Multi-GPU support - Githubissues

thuml / Time-Series-Library

A Library for Advanced Deep Time Series Models.

MIT License

6.98k stars 1.1k forks source link

Multi-GPU support #440

Open YuMeng2v opened 4 months ago

YuMeng2v commented 4 months ago

Hey guys, thanks for your great work, I wonder how to set Multi-GPU, I have realized some all reduce but look no fancy. Can you help to support Multi-GPU training and testing, thank you!

kwuking commented 2 months ago

Hi, in the run.py script, the parameters use_multi_gpu and devices are available for configuring multi-GPU parallel execution. Currently, the TSLib repository supports PyTorch's data parallel mode for parallel processing. If you want to use PyTorch's DDP ( Distribute Data Parallel) mode, please refer to the official DDP document for modification and adaptation.