search

stickeritis / sticker

Succeeded by SyntaxDot: https://github.com/tensordot/syntaxdot
Other
25 stars 2 forks source link

Make exponential learning-rate decay per step. #145

Closed twuebi closed 4 years ago

twuebi commented 4 years ago

Make the decay in the ExponentialRate schedule based on the global step instead of the training epoch.