search

WongKinYiu / yolov7

Implementation of paper - YOLOv7: Trainable bag-of-freebies sets new state-of-the-art for real-time object detectors
GNU General Public License v3.0
13.36k stars 4.22k forks source link

Does the learning rate have anything to do with the number of gpus? #492

Open starspder opened 2 years ago

starspder commented 2 years ago

Hi, thank you for providing the nice model!!

I have a question about the relationship between the number of gpus and the learning rate.

For darknet, learning_rate = learning_rate / number of gpus is mainly used.

I'm going to use about 6 gpus. Is there any problem with setting learning rate to 0.001 as default?

WongKinYiu commented 2 years ago

world size related to number of gpus. You need not to change anything when using multiple gpus for training.