mbadry1 / DeepLearning.ai-Summary

This repository contains my personal notes and summaries on DeepLearning.ai specialization courses. I've enjoyed every little bit of the course hope you enjoy my notes too.
MIT License
5.17k stars 2.44k forks source link

Change Tanh to Relu line 178 #151

Closed mxc19912008 closed 6 years ago

mxc19912008 commented 6 years ago

Change Tanh to Relu since there is no linear part in tanh. It should be relu instead.

mbadry1 commented 6 years ago

Tanh has a linear part. Check this image.

tanhreal

Your edit it true for RELU, but the provided intuition applies to Tanh too as well.

mxc19912008 commented 6 years ago

Yeah, right! Thanks for pointing it out!