The learning rate is related to batch size?

OceanPang / Libra_R-CNN

Code for CVPR 2019 paper "Libra R-CNN: Towards Balanced Learning for Object Detection"

Apache License 2.0

367 stars 49 forks source link

Closed hdjsjyl closed 5 years ago

hdjsjyl commented 5 years ago

Thanks for sharing your work. From ReadMme, I got the learning rate is related to the number of GPUs, so it is also related to the batch size? Thanks

OceanPang commented 5 years ago

@hdjsjyl Yes. For example, 2 imgs per gpu with 8 gpus totally on MS COCO needs a lr = 0.02. If you only use 1 gpu. The lr = 0.02 / 8.