setup baseline models - Githubissues

c-schicho / ZeroInitializationLearningDynamics

This project is about examining how the initialization of the biases impacts the learning behavior when weights are zero-initilized.

MIT License

0 stars 0 forks source link

Closed c-schicho closed 1 year ago

c-schicho commented 1 year ago

for the experiments we want to have two baseline models.

the one should be a model initialized with a common initialization method
the other one should be a model with zero weight initialization and biases initialized from a standard normal distribution.

setup these models for the MNIST dataset.