danluu / UFLDL-tutorial

Deep Learning and Unsupervised Feature Learning Tutorial Solutions
ufldl.stanford.edu/wiki/index.php/UFLDL_Tutorial‎
393 stars 188 forks source link

why omit the bias in softmax regression #1

Open samuel1208 opened 10 years ago

RalphMao commented 10 years ago

I am also wondering about it

nik-ko commented 9 years ago

"Another property that could potentially be interesting is that the softmax output is invariant under additive changes of its input vector: softmax(a) = softmax(a + b) when b is a scalar added to all the elements of vector a. " from: http://www.iro.umontreal.ca/~bengioy/dlbook/mlp.html#pf8

Or: http://ufldl.stanford.edu/wiki/index.php/Softmax_Regression