Implement a decaying learning rate

tarrade / proj_multilingual_text_classification

Explore multilingal text classification using embedding, bert and deep learning architecture

Apache License 2.0

5 stars 2 forks source link

Closed vluechinger closed 4 years ago

vluechinger commented 4 years ago

[x] Would it be beneficial to be able to choose between different types of decay (not just exponential)?
[x] How to be able to see the changing learning rate in the logs?
[x] Which is preferable: tf.keras.callbacks.LearningRateScheduler or tf.keras.optimizers.schedules.ExponentialDecay? (both should work now but I could not see the learning rate)

tarrade commented 4 years ago

One issue to understand but the implementatiuon is done