Replace horovod with DDP

TRI-ML / packnet-sfm

TRI-ML Monocular Depth Estimation Repository

https://tri-ml.github.io/packnet-sfm/

MIT License

1.24k stars 243 forks source link

Replace horovod with DDP #75

Closed MingYang-buaa closed 4 years ago

MingYang-buaa commented 4 years ago

Hey, Is there anyone has tried to replace horovod with ddp? I'm trying to train the model with DDP, but i failed to replace the hvd.allreduce with torch.all_reduce. Open to any suggestion.

VitorGuizilini-TRI commented 4 years ago

I'm very interested in eventually replacing horovod with ddp. Unfortunately that is not a high priority right now for the repository, but if you manage to get it working please let me know! I will have a look as well to see if I find a way around this all_reduce issue. Thanks!