search

BayesWatch / pytorch-experiments-template

A pytorch based classification experiments template
GNU General Public License v3.0
5 stars 1 forks source link

Implement Distributed Data Parallel #59

Open AntreasAntoniou opened 3 years ago

AntreasAntoniou commented 3 years ago

Replace nn.DataParallel, with nn.parallel.DistributedDataParallel, because it offers better performance on single machine settings, and allows for easy extensions to multi machine settings. Training dem transformers might require that..

57