p2ch11: 13,5 hours to train for one epoch

deep-learning-with-pytorch / dlwpt-code

Code for the book Deep Learning with PyTorch by Eli Stevens, Luca Antiga, and Thomas Viehmann.

https://www.manning.com/books/deep-learning-with-pytorch

4.69k stars 1.98k forks source link

p2ch11: 13,5 hours to train for one epoch #92

Closed sgkouzias closed 5 months ago

sgkouzias commented 2 years ago

I use an RTX 3060 12GB GPU enabled desktop with RAM of 16GB DDR4 and CPU Intel Core i5 10400F. Also I mounted an external storage HDD drive and ran p2ch11.prepcache… Used from zero to 8 workers and various batch size selections ranging from 32 to 1024!! Still it takes approximately 13,5 hours to train for one epoch (with batch size=1024 and 4 workers!!)… I still haven’t figured what’s wrong… Looks like I cannot utilize the GPU for some reason …