Closed ahmdtaha closed 4 years ago
Through multiple experiments, I found that removing this weight initializer (weights_initializer=tf.orthogonal_initializer()) leads to a stabler performance.
Can you please explain the intuition for using this weight initializer? Thanks
Only happens with old tf version (1.8). Seems stabler with tf 1.14
Through multiple experiments, I found that removing this weight initializer (weights_initializer=tf.orthogonal_initializer()) leads to a stabler performance.
Can you please explain the intuition for using this weight initializer? Thanks