hardmaru / estool

Evolution Strategies Tool
Other
928 stars 163 forks source link

Natural gradients for deep layers #26

Open parvkpr opened 4 years ago

parvkpr commented 4 years ago

In NES algorithms do we use backpropogation from the last layers gradients(computed by the objectve function). I am curious as to how to optimize the hidden layers since they are not directly affecting the objective function

jinyeom commented 4 years ago

Evolution strategies do not use backpropagation, but they differentiate (approximately) across a population of solutions, rather than across parameters within a solution. Perhaps reading this blog post is useful :stuck_out_tongue: