How to use more than 2 GPUs at the same time?

tensorflow / nmt

TensorFlow Neural Machine Translation Tutorial

Apache License 2.0

6.37k stars 1.96k forks source link

How to use more than 2 GPUs at the same time? #300

Open tolotrasamuel opened 6 years ago

tolotrasamuel commented 6 years ago

I have 3 * GeForce GTX 1060 6G
I tried to put num_gpus = 3 in hparams as a propriety for the dictionary. However, I noticed that only 2 gpu are being used As you can one the screenshot above, the 3rd GPU is not used at all. GPU0 is used at around 60% on average and GPU1 is at 100%. Why aren't all of them used at 100% ? I made sure however to set num_gpus = 3