the-deep-learners / deep-learning-illustrated

Deep Learning Illustrated (2020)
https://www.deeplearningillustrated.com
MIT License
708 stars 355 forks source link

backpropagation on appendix B #6

Closed ricky-lim closed 4 years ago

ricky-lim commented 4 years ago

Hi Jon,

I would like to double check with formula part of B.6 at the appendix, please. defining the gradient of the activation function w.r.t. z

CodeCogsEqn

Given B.2, I thought part of B.6 should be:

CodeCogsEqn (1)

Please check if it is correct and please do let me know otherwise.

Thank you in advance for your time and consideration.

Cheers

jonkrohn commented 4 years ago

Thanks for this, @ricky-lim ! Thoughts, @grantbey ?

grantbey commented 4 years ago

Hi @ricky-lim,

Thanks for this - you're absolutely correct. That term should, in fact, be:

.

Thus, the equation in B.6 should be corrected to:

image

Thanks for the catch. We'll submit the typo to the publishers for correction.

Well done!