Closed twuebi closed 4 years ago
Make the decay in the ExponentialRate schedule based on the global step instead of the training epoch.
ExponentialRate
Make the decay in the
ExponentialRate
schedule based on the global step instead of the training epoch.