Training time about Multi GPUs and Single GPU

soumith / imagenet-multiGPU.torch

an imagenet example in torch.

BSD 2-Clause "Simplified" License

402 stars 158 forks source link

Training time about Multi GPUs and Single GPU #97

Open xieshuqin opened 7 years ago

xieshuqin commented 7 years ago

Hi I have a question about how many time we can save when we change from single GPU to multi GPUs?

I don't have imageNet on my server, so can anyone show me the single step time (loading data + forward time + backward time) of the multi GPUs version and single GPU?

Thank you very much!

xuyifeng-nwpu commented 7 years ago

I had trained the Cifar 10 dataset with the resnet model. Four GPUs about 3hours. Single GPU about 10hours.