search

c-schicho / ZeroInitializationLearningDynamics

This project is about examining how the initialization of the biases impacts the learning behavior when weights are zero-initilized.
MIT License
0 stars 0 forks source link

log / plot distributions #3

Closed c-schicho closed 3 months ago

c-schicho commented 1 year ago

add tensorboard summary writer to log the stats during training.

additionally add a utils function which allows to plot the pre-activations and activations distribution.