hardmaru / WorldModelsExperiments

World Models Experiments
608 stars 171 forks source link

Questions about the doom's action space #7

Closed NoListen closed 6 years ago

NoListen commented 6 years ago

We know that the doom's action space is discrete(3).

Have you tried using discrete actions instead of transferring them to continuous action?

Will one single continuous action be more beneficial/efficient in the evolution strategy ?

hardmaru commented 6 years ago

Hi @NoListen

I haven't tried on the 3 discrete action space, bit it should work (although the ES algorithm might converge slower since you will have 3 times the number of parameters to optimize for).

So having one continuous action is more beneficial in the sense that optimizing for it with an ES is more efficient.

NoListen commented 6 years ago

Thanks for your reply.