imatge-upc / detection-2016-nipsws

Hierarchical Object Detection with Deep Reinforcement Learning
http://imatge-upc.github.io/detection-2016-nipsws/
MIT License
423 stars 129 forks source link

Something about training time #10

Closed Lan1991Xu closed 7 years ago

Lan1991Xu commented 7 years ago

Hi all. I train the pool45_crops_training.py, but it almost 4 days to get the mature model. I figure out, when the training stage, the GPU utilization is almost between 0 and 20%. So is there any wrong when i am training? I environment is Keras 1.1 theano 0.8.2 CUDA7.5 CUDNN 5.0 python 2.7

miriambellver commented 7 years ago

Hi!

It also took some days for me. The GPU utilization is low because there is processing each time an action is performed, which is not performed on GPU. If you optimize it, let us know!

Míriam