search

LambdaColdStorage / lambda-tensorflow-benchmark

BSD 3-Clause "New" or "Revised" License
234 stars 60 forks source link

How to benchmark with multiple GPUs? #6

Open waynehuu opened 5 years ago

waynehuu commented 5 years ago

I tried to change the MAX_NUM_GPU in line 9 of benchmark.sh but it didn't work.

Thanks!

nanwei1 commented 5 years ago

In my setup I have 4 GPUs and I wanted to run only 1 iteration for each test, so I ran the test by: ./benchmark.sh 0,1,2,3 1 where 0,1,2,3 are the GPU indices. Modify this according to your system and it should work.

If you want to test speed-ups from single GPU to multiple ones, change line 8 and 9 of benchmark.sh to the following: MIN_NUM_GPU=1 MAX_NUM_GPU=${#gpus[@]}