Learning-rate warmup + polynomial schedule - Githubissues

MyrtleSoftware / myrtlespeech

Speech recognition

Other

8 stars 1 forks source link

Learning-rate warmup + polynomial schedule #22

Open julianmack opened 4 years ago

julianmack commented 4 years ago

Added learning-rate warmup scheduler and polynomial scheduler.

This currently blocked by PRs:

RNN-T: https://github.com/MyrtleSoftware/myrtlespeech/pull/7
state_dict: https://github.com/MyrtleSoftware/myrtlespeech/pull/19