search

ahy69195 / AlbertYou_TasksQRG

Development for the lab
0 stars 0 forks source link

Formula Clarifications (Continuous) #6

Open ahy69195 opened 2 years ago

ahy69195 commented 2 years ago
Screen Shot 2021-11-07 at 10 16 07 PM

How does the partial derivative become a0 = a0 - alpha (etc.) and a1 = a1 - alpha (etc.) ?

ahy69195 commented 2 years ago

I understand now, we take the partial derivatives (gradients) to find the new values of a0 and a1 by using this formula. Correct me if I'm wrong.

Screen Shot 2021-11-08 at 7 35 47 AM

where b is the new value and a is the previous value and gamma is the learning rate (hyper parameter) and "( Δf(a) ) is simply the direction of the steepest descent."