yagamiram / opennero

Automatically exported from code.google.com/p/opennero
Other
0 stars 0 forks source link

rtNEAT agents not learning when team is loaded from file #128

Closed GoogleCodeExporter closed 8 years ago

GoogleCodeExporter commented 8 years ago
What steps will reproduce the problem?
1. Go to NERO Training
2. Load team from file

What is the expected output? What do you see instead?
I don't know if it is an intended feature that a team loaded from file cannot 
be trained anymore. From the console output, the fitness of the CHAMP remains 
to be 0 for the current and subsequent generations. As expected, the population 
eventually does not meet the goals (less and less agents approach the enemy, 
for example).

What version of the product are you using? On what operating system?
Revision 1538. Gentoo Linux.

Original issue reported on code.google.com by klan...@gmail.com on 7 Dec 2011 at 11:44

GoogleCodeExporter commented 8 years ago
Thanks, looking into this!

Original comment by ikarpov on 7 Dec 2011 at 1:00

GoogleCodeExporter commented 8 years ago

Original comment by ikarpov on 7 Dec 2011 at 1:00

GoogleCodeExporter commented 8 years ago
It looks like at least part of the problem is that you cannot change the 
sliders which provide the weight for different rewards and punishments. If the 
weights are set to zero, no matter what the agent does, the combined fitness 
(which is calculated as a weighted sum of Z-scores in each fitness dimension) 
will be zero...

Original comment by ikarpov on 7 Dec 2011 at 5:11

GoogleCodeExporter commented 8 years ago
Oh, I was able to move sliders by first starting a new rtNEAT team. The sliders 
would now then be movable. After that, I would load the old team from file.

Original comment by klan...@gmail.com on 7 Dec 2011 at 6:32

GoogleCodeExporter commented 8 years ago
OK, r1551 enables the sliders whenever a team is loaded.

I believe the problem is just that the new rtNEAT object created when you load 
your team doesn't yet know what the weights are it should be using. The fix is 
to have the menu send all the slider values whenever the team is loaded. The 
workaround is to move each non-zero slider back and forth to re-send the 
weights.

Original comment by ikarpov on 7 Dec 2011 at 8:17

GoogleCodeExporter commented 8 years ago
I think r1553 fixes this - langga, please confirm if you can (to do so before 
the build comes out, just replace NERO/menu.py with the most recent version.

Original comment by ikarpov on 7 Dec 2011 at 8:39

GoogleCodeExporter commented 8 years ago
Yup, it's fixed now, thanks!

Original comment by klan...@gmail.com on 8 Dec 2011 at 6:35

GoogleCodeExporter commented 8 years ago
Yup, it's fixed now, thanks!

Original comment by klan...@gmail.com on 8 Dec 2011 at 6:35