search

cs231n / cs231n.github.io

Public facing notes page
MIT License
10.12k stars 4.06k forks source link

optimization-1 - Strategy #2: Random Local Search formula fix #235

Closed or-toledano closed 4 years ago

or-toledano commented 4 years ago

232

Strategy #2: Random Local Search The "random perturbation" of the form \delta W which is added to W doesn't make sense - the formula describes scaling W by (1+ \detla) instead of adding to W a random (independent from W), weight matrix. You can see that the code updates W correctly: W + np.random.randn(10, 3073) * step_size e.i. a random matrix times \delta := step_size is added to W, instead of adding \delta times W to W. I proposed in #232 to change \delta W to \delta W'. selected-200720-1804-14

brentyi commented 4 years ago

Thanks for the bump! Responded in #232.