search

IDEA-Research / detrex

detrex is a research platform for DETR-based object detection, segmentation, pose estimation and other visual recognition tasks.
https://detrex.readthedocs.io/en/latest/
Apache License 2.0
1.95k stars 204 forks source link

Wrong lr schedule if batch size changes? #214

Closed rayleizhu closed 1 year ago

rayleizhu commented 1 year ago

It seems that detrex currently has only IterBasedRunner implemented, and assumes a constant batch size of 16, right? As a result, If I change the batch size (for example, 16 -> 64 for more efficient training on GPUs with larger memory, such as V100 or A100), the lr schedule will be wrong, right?

rentainhe commented 1 year ago

It seems that detrex currently has only IterBasedRunner implemented, and assumes a constant batch size of 16, right? As a result, If I change the batch size (for example, 16 -> 64 for more efficient training on GPUs with larger memory, such as V100 or A100), the lr schedule will be wrong, right?

Yes, you should change the scheduler at the same time~ we will try to modify this part in detrex in next version

rentainhe commented 1 year ago

I'm closing this issue~ feel free to reopen it if needed~