search

muammar / ml4chem

ML4Chem: Machine Learning for Chemistry and Materials
https://ml4chem.dev
Other
93 stars 15 forks source link

Create some rule to initialize models #5

Open muammar opened 5 years ago

muammar commented 5 years ago

The biases are not correctly initialized. I should create some kind of trick to have them starting to values that make sense for the problem in question.

muammar commented 5 years ago

Fixed in 9bddd0799f18f945a05223dccaac50efe409797e.

muammar commented 5 years ago

I am reopening this issue after reading this article in medium:

https://medium.com/usf-msds/deep-learning-best-practices-1-weight-initialization-14e5c0295b94

Depending on the activation function used the weights have to be initialized differently.