search

BVishal-Geek / Year-2024-Progress

0 stars 0 forks source link

Deep Learning #2

Open BVishal-Geek opened 5 months ago

BVishal-Geek commented 5 months ago

Started deep learning from Neural Networks Course of Andrew NG

BVishal-Geek commented 5 months ago

Completed Gradient Descent.

J(w,b) =

  1. w - learning_rate * (d J(w,b)/dw)
  2. b - learning_rate * (d J(w,b)/db)
BVishal-Geek commented 4 months ago

Learned activation functions.

  1. Sigmoid
  2. Tanh
  3. ReLU
  4. Leaky ReLU
  5. Parametric ReLU
  6. SWISH
  7. Softplus
  8. Softmax