Training time of PASCAL VOC 2012

scaelles / DEXTR-PyTorch

Deep Extreme Cut http://www.vision.ee.ethz.ch/~cvlsegmentation/dextr

GNU General Public License v3.0

843 stars 153 forks source link

Training time of PASCAL VOC 2012 #22

Closed michaelzhou0723 closed 5 years ago

michaelzhou0723 commented 5 years ago

Hello! I run the provided train_pascal.py (PSCAL VOC 2012 without SBD) on a Tesla V100 GPU, and it seems to take roughly half an hour to complete one epoch. But in the publication you mentioned it took you 20 hours for 100 epochs on a Titan X. Is there anything I should tune in order to achieve the same speed?

scaelles commented 5 years ago

Hello, Training time depends on a lot of factors and the GPU is only one of them. I would recommend that you maximize the GPU utilization making sure that reading the data is not the bottleneck.