Results on multi-GPUs is better than on one GPU

Cysu / open-reid

Open source person re-identification library in python

https://cysu.github.io/open-reid/

MIT License

1.33k stars 349 forks source link

Results on multi-GPUs is better than on one GPU #59

Closed wangchust closed 6 years ago

wangchust commented 6 years ago

Does anyone encounter this phenomenon, results on 4 GPUs are better than on 2GPUs. Results on 2GPUs are better than on 1 GPU. The other parameters are all kept same, including learning rate. Does anyone know why?

bnu-wangxun commented 6 years ago

Yes, I have the same problem. I think better performance of 4 GPU comes from that the average process of derivative on different GPUs .

Cysu commented 6 years ago

Please check this section on our website.

wangchust commented 6 years ago

Thank you @bnulihaixia and @Cysu . This open-reid framework is really an exitcing work!!!