search

carpentries-incubator / machine-learning-neural-python

Introduction to artificial neural nets with Python
https://carpentries-incubator.github.io/machine-learning-neural-python
Other
5 stars 8 forks source link

Adding section on activation functions and updating placeholder pictures #5

Closed hwarden162 closed 2 years ago

hwarden162 commented 2 years ago

I've added a small section on activation functions. Included the idea of a neuron being active or inactive. Included two sigmoidal functions (sigmoid and tanh) and then two examples of ReLU functions. Mentioned the idea of neural network saturation and how this can slow learning rate.

I also updated two placeholder pictures.

All figures are self made so there are no copyright problems.

tompollard commented 2 years ago

Looks good to me, thanks!