search

LxMLS / lxmls-guide

Lisbon Machine Learning Summer School Lab Guide
81 stars 61 forks source link

Mistake in Backpropagation Algorithm (Algorithm 11, page 75) #115

Open goncalomcorreia opened 6 years ago

goncalomcorreia commented 6 years ago

Line 20 of algorithm 11 should be outside of the for loop that starts in line 8. Otherwise, the weights will be updated before all the gradients are computed.

ramon-astudillo commented 6 years ago

It will also need new a loop over the layers and this may be to big to fit. We should think in general how to express these. Maybe just focus on the batch update.