How to use multi-GPU training

google-research / multinerf

A Code Release for Mip-NeRF 360, Ref-NeRF, and RawNeRF

Apache License 2.0

3.58k stars 339 forks source link

How to use multi-GPU training #36

Closed CSU-NXY closed 1 year ago

CSU-NXY commented 1 year ago

Hi, I'm trying to train MipNeRF360 with 4 GPUs. Should I remain the batch_size untouched or multiply 4 to it? Is there any other changes I should do to support multi-GPU training?

Thanks!

jonbarron commented 1 year ago

If you decrease the batch size, you should increase the number of iterations and decrease the learning rate according to the linear scaling rule.

hecodeit commented 1 year ago

@CSU-NXY I'm same question as you, did you find the way of configuration for multiple GPU?