download: do not busy loop, share url list between threads

Tencent / tencent-ml-images

Largest multi-label image database; ResNet-101 model; 80.73% top-1 acc on ImageNet

Other

3.05k stars 514 forks source link

download: do not busy loop, share url list between threads #34

Open sergezloto opened 5 years ago

sergezloto commented 5 years ago

Fixed main thread that was taking 100% cpu actively polling for other thread exits. Reuse the list of URLs instead of creating and reading in each thread.

wubaoyuan commented 5 years ago

@sergezloto Thanks a lot. We will test your pulled codes asap.