search

LxMLS / lxmls-guide

Lisbon Machine Learning Summer School Lab Guide
81 stars 61 forks source link

Backpropagation #69

Closed dcferreira closed 9 years ago

dcferreira commented 9 years ago

Some corrections on chapter 6.4.1. Please double-check, in particular equations 6.31, 6.32 and 6.34, but I believe my changes are correct.

ramon-astudillo commented 9 years ago

Merged most of the changes. The n -> N in formulas was incorrect.

dcferreira commented 9 years ago

In equation 6.17 in particular, n isn't defined. What I understood was that the gradient of layer n only depends on the layers after n (that is, from n to N), so the layer n-1 shouldn't be there.

Did I get this wrong?

ramon-astudillo commented 9 years ago

Regarding Eq 6.17 and the definition of n/N, you are right I will make it more clear and take your n-1 -> N-1 suggestion.

Regarding the gradient question, are you referring to the typo you found in Eq. 6.32?. I had included that one.

dcferreira commented 9 years ago

My post was only about the n-1 -> N-1 subject. I think your commit is correct :)