search

clabra / opennero

Automatically exported from code.google.com/p/opennero
Other
0 stars 0 forks source link

Roomba: Reward in first step is doubled #7

Closed GoogleCodeExporter closed 9 years ago

GoogleCodeExporter commented 9 years ago 
What steps will reproduce the problem?
Run the Roomba module a few times (either script or rtNEAT) until one of the 
agents receives a reward in the very first step. If you look at the agent's 
fitness in the next step, it's evident that the first step reward was doubled.

What version of the product are you using? On what operating system?
Version 403 checked out from /branches/merge/, running on Linux

Original issue reported on code.google.com by karunra...@gmail.com on 23 Jun 2010 at 12:20

GoogleCodeExporter commented 9 years ago 
Looking into this...

Original comment by ikarpov on 7 Jul 2010 at 3:40

GoogleCodeExporter commented 9 years ago 
[deleted comment]
GoogleCodeExporter commented 9 years ago

Original comment by ikarpov on 11 Aug 2010 at 7:17

GoogleCodeExporter commented 9 years ago 
Very nice catch! I had trouble seeing what you meant at first, but Revision 
#446 fixes this issue. This problem was actually on the code side and so would 
affect the second step fitness in any non-zero first-step-reward environment.

Please verify that this is fixed.

Original comment by ikarpov on 17 Aug 2010 at 7:14