hardmaru / estool

Evolution Strategies Tool
Other
933 stars 162 forks source link

class OpenES, function ask: np.array mu come from update and compute step Adam optimizer with shape(popsize, numparams) and it was error when try to reshape mu.reshape(1, self.num_params) #23

Closed geotyper closed 5 years ago

geotyper commented 5 years ago

self.solutions = self.mu.reshape(1, self.num_params) + self.epsilon * self.sigma

 def _compute_step(self, globalg):
    a = self.stepsize * np.sqrt(1 - self.beta2 ** self.t) / (1 - self.beta1 ** self.t)
    self.m = self.beta1 * self.m + (1 - self.beta1) * globalg
    self.v = self.beta2 * self.v + (1 - self.beta2) * (globalg * globalg)
    step = -a * self.m / (np.sqrt(self.v) + self.epsilon)
    return step
geotyper commented 5 years ago

I found my error compute_step epsilon is another epsilon from ask module