Open albertvillanova opened 4 years ago
As said in the videos, and from the plot of the loss vs. the learning rate, the optimal value for the learning rate lies between 1e-6 and 1e-5.
However, it is set the value: 5e-5, which is larger than 1e-5.
Instead, it should be set a value within the range [1e-6, 1e-5], e.g. 5e-6.
As said in the videos, and from the plot of the loss vs. the learning rate, the optimal value for the learning rate lies between 1e-6 and 1e-5.
However, it is set the value: 5e-5, which is larger than 1e-5.
Instead, it should be set a value within the range [1e-6, 1e-5], e.g. 5e-6.