Closed nachiket92 closed 2 years ago
Instead of a fixed learning rate of 0.0001, use a learning rate schedule. Start with a learning rate of 0.001, halve after 10 epochs. Model trains faster, achieves slightly better results.
Instead of a fixed learning rate of 0.0001, use a learning rate schedule. Start with a learning rate of 0.001, halve after 10 epochs. Model trains faster, achieves slightly better results.