search

c-schicho / ZeroInitializationLearningDynamics

This project is about examining how the initialization of the biases impacts the learning behavior when weights are zero-initilized.
MIT License
0 stars 0 forks source link

experiments with uniform distribution #8

Closed c-schicho closed 1 month ago

c-schicho commented 1 year ago

derive the theory for uniform init. try the results in some experiments.

try to use deterministic init, use linspace for this.