Open sleeplessai opened 3 years ago
I found commands about multi-GPU training in train_mvs_nerf_pl.py but it turned out not working
@sleeplessai @frspring It seems that to enable multi-GPU training such as DDP, there are some modifications to do.
self.MVSNet = self.render_kwargs_train['network_mvs'] self.network = self.render_kwargs_train['network_fn'] self.network_fine = self.render_kwargs_train['network_fine'] self.render_kwargs_train.pop('network_mvs') self.render_kwargs_train.pop('network_fn') self.render_kwargs_train.pop('network_fine')
and change other relevant parts accordingly.
After the above three steps, train_mvs_nerf_pl.py works on my server (with 5 TiTAN RTXs). Please refer to the following links for details.
https://pytorch-lightning.readthedocs.io/en/latest/advanced/multi_gpu.html
https://github.com/PyTorchLightning/pytorch-lightning/issues/2515
Hope this can help you.@zhuangdf Great! Could you please share the mult-gpu mvsnerf code?
@zhuangdf
Hi, thanks for sharing this! May I know why do you need to self.render_kwargs_train.pop('network_fn')
? Thanks!
Does this model support multi-GPU training ? If do support and require, how to set in code ?