openai / evolution-strategies-starter

Code for the paper "Evolution Strategies as a Scalable Alternative to Reinforcement Learning"
https://arxiv.org/abs/1703.03864
MIT License
1.57k stars 278 forks source link

Discrete actions #11

Closed ErnstTmp closed 7 years ago

ErnstTmp commented 7 years ago

Hello, I am playing with your code, and it is great, I learned a lot!! Now, I want to use it for a project with discrete actions. I set "ac_bins": "uniform:3" in the config json and expected to get 3 discrete actions between low and high, but this was not the case. How can I get discrete actions?

Thanks and kind regards Ernst

ErnstTmp commented 7 years ago

Hello, found the problem. There was ac_noise_std = 0.01, and that added a little bit of noise to the actions. When setting the noise to 0., it works. Kind regards Ernst