search

Kannampuzha / neural_network

a neural network
2 stars 4 forks source link

add a few activation functions #1

Open Kannampuzha opened 2 years ago

Kannampuzha commented 2 years ago

make some activation functions and put them together in a file 'activation_functions.py'

paultristanwagner commented 2 years ago

I would like to to collect some activation functions. Can you assign this issue to me?

Kannampuzha commented 2 years ago

if u find any other functions worth for activation , do add them (regardless of being linear or nonlinear) as for the derivatives , it wouldnt be needed in this particular expeiment.

ruankie commented 2 years ago

Just added two more activation functions to activation_functions.py in a pull request:

  1. Linear activation function f(x)=x
  2. Hyperbolic tangent activation function f(x)=tanh(x)