Closed Z-Z-J closed 4 years ago
Now I havn't implemented multi-GPU training because this model doesn't require a lot of resourecs. But I will support it to support multi-GPU training, thanks for your feekback!
Hi @Shimingyi, were you have to implement multi-GPU training?
I seem to find two code errors! In base_trainer.py
code: if gpu_id > n_gpu: msg = "Warning: The number of GPU\'s configured to use is {}, but only {} are available on this machine.".format(n_gpu_use, n_gpu)
code: list_ids = list([gpu_id]) if len(device_ids) > 1: self.model = torch.nn.DataParallel(model, device_ids=device_ids)