search

TMElyralab / MuseTalk

MuseTalk: Real-Time High Quality Lip Synchorization with Latent Space Inpainting
Other
1.84k stars 219 forks source link

Multi-GPU usage for inference #92

Open paulovasconcellos-hotmart opened 1 month ago

paulovasconcellos-hotmart commented 1 month ago

Hello, thank you very much for this amazing contribution.

I was wondering if it's possible to use multi-GPU for inference. I have 8xA100, but when I use it for inference, just one of them is used throughout the whole process. What can I do to use all my GPUs for inference?

你好，非常感谢你做出的这项了不起的贡献。

我想知道是否可以使用多GPU进行推理。我有8个A100显卡，但是在推理过程中，只使用其中一个。我要怎样做才能在推理中使用所有的GPU呢？

anstonjie commented 1 month ago

我也是同样的问题，期待解决

czk32611 commented 1 month ago

Why would you want to use multi GPU for inference? Do you want to inference 8 different audios simultaneously or want to split an audio to 8 segments?

paulovasconcellos-hotmart commented 1 month ago

I'm aiming to make faster inferences for individual video clips. So a long video could be split among my gpus so I can deliver it faster

paulovasconcellos-hotmart commented 3 weeks ago

@czk32611 If you need any help, I can submit a PR to make inferences with multi-GPU. Let me know if that is something interesting for you.

czk32611 commented 3 weeks ago

@czk32611 If you need any help, I can submit a PR to make inferences with multi-GPU. Let me know if that is something interesting for you.

that would be great!