Closed suyanzhou626 closed 4 years ago
Did you adopt the lr scheduler in the experiments ? or it's ok for 1e-4 all the time?
If I remember correctly the results were slightly better when using a lr scheduler.
Did you adopt the lr scheduler in the experiments ? or it's ok for 1e-4 all the time?