search

zhanghang1989 / PyTorch-Encoding

A CV toolkit for my papers.
https://hangzhang.org/PyTorch-Encoding/
MIT License
2.04k stars 450 forks source link

About train time #381

Open xLuge opened 3 years ago

xLuge commented 3 years ago

I train deeplab on 4gpus，each gpu 16g, but Each EPOCH training time takes more than an hour.Is this normal?

zhanghang1989 commented 3 years ago

The training using DataParallel is really slow (due to syncbn). You may try using train_dist.py, which is much faster.