Closed terkkila closed 10 years ago
Looking at weight statistics oftentimes reveal if learning is going to succeed or not. For example, if the bias term dominates the weight matrix, it means that the transformation at that layer is fairly unchanged to varying inputs.
Looking at weight statistics oftentimes reveal if learning is going to succeed or not. For example, if the bias term dominates the weight matrix, it means that the transformation at that layer is fairly unchanged to varying inputs.