Closed Liza23 closed 2 years ago
Hi Liza, usually, there's randomness involved when network weights are initialized. Try manually setting the random see for torch and numpy will guarantee reproducible results.
If you're worried about the model being susceptible to random seeding, can you share your code so I can know which ODE you're solving and what hyperparameters you are using?
I've been trying to solve some ordinary differential equation (in one variable) but each time I run the model, I get different results -- sometime exactly as expected and other times entirely opposite to what is expected. How can this be reliable in such a case?
The training & validation error is usually pretty low and hence doesn't add to model misbehaving.