Please provide argument or configuration to support multiple CUDA devices

PKU-YuanGroup / MagicTime

MagicTime: Time-lapse Video Generation Models as Metamorphic Simulators

https://pku-yuangroup.github.io/MagicTime/

Apache License 2.0

1.31k stars 125 forks source link

Please provide argument or configuration to support multiple CUDA devices #20

Closed truedat101 closed 6 months ago

truedat101 commented 7 months ago

Current set up defaults to GPU 0, and will run out of memory on a single GPU <= 8GB VRAM. Ideally there is some configuration to support specifying the GPU to use, or a number of GPUs to use.

SHYuanBest commented 7 months ago

Thanks for your interest. We will take your suggestions into consideration and may update the multi-GPU version of the inference code in the future.

truedat101 commented 6 months ago

Oh, is it just this? CUDA_VISIBLE_DEVICES=0

Change 0 to 0,1,...

SHYuanBest commented 6 months ago

Currently only the first GPU is used by default