search

zhanwenchen / relaug

MIT License
0 stars 0 forks source link

Transformer+BPL Not Good with LR=0.016 #129

Closed zhanwenchen closed 1 year ago

zhanwenchen commented 1 year ago

BPL: stop using config BASE_LR and use LR=0.001