search

zhanwenchen / relaug

MIT License
0 stars 0 forks source link

Reimplement learning rate factor scaling with batch size and ceiling #142

Closed zhanwenchen closed 1 year ago

zhanwenchen commented 1 year ago

lr_factor = min(float(batch_size_all_gpus), MAX)