Closed wuqiangch closed 5 years ago
In the paper, learning rate is adaptive, changing it "decrease it by half every 30M steps". however, code is same in every iteration. Should I add learning rate schedular? or change the optimizer which has learning_rate_decay parameter? any suggestion, comment, whatever? thank you
In you code ,the learning rate allways keeps 0.01 and does not change during the train process.