Some hyperparameters may cause unstable optimization and lead to nans. The code currently ignores this and return the nans without raising the error. An exception with informative message (suggesting the change of learning rate for example) could improve user experience.
Some hyperparameters may cause unstable optimization and lead to nans. The code currently ignores this and return the nans without raising the error. An exception with informative message (suggesting the change of learning rate for example) could improve user experience.