search

sanscript-tech / hacking-tools-scripts

Hacking Scripts that will blow your mind engineered by Hackers ♠️.
GNU General Public License v3.0
52 stars 59 forks source link

Activation Functions #94

Open balapriyac opened 3 years ago

balapriyac commented 3 years ago

Write code the following Activation Functions

Be sure to include the plots and elaborate on the advantages and disadvantages (vanishing gradient, dead neuron problem etc for example)

Sigmoid, ReLU, Leaky ReLU, tanh, Swish,Mish

1liale commented 3 years ago

Hey @balapriyac I am interested in contributing. Although I am still relatively new to ML so might need a bit of help from time to time.