Training speed is getting lower

kenshohara / 3D-ResNets-PyTorch

3D ResNets for Action Recognition (CVPR 2018)

MIT License

3.91k stars 933 forks source link

Training speed is getting lower #193

Closed sudonto closed 4 years ago

sudonto commented 4 years ago

Hi, just wondering why my training speed is decreased within 1 epoch? I mean, after around 10% of total batch, my training speed is dcreased? GPU utilization is drop from consistent of 100% to fluctuated speed. Anyone has similar symptom like me?

sudonto commented 4 years ago

weird, upgrade python to 3.7 and downgrade pytorch to 1.1 cure this issue. closed.