search

oneturkmen / evolving-nets

Neuroscience-inspired optimization algorithm known as NeuroEvolution of Augmenting Topologies (NEAT)
0 stars 0 forks source link

Fixed topology NN: check if it works properly #6

Closed oneturkmen closed 5 years ago

oneturkmen commented 5 years ago

I am suspicious on this, since sometimes it optimizes, sometimes it doesn't check if the code is working properly there.

oneturkmen commented 5 years ago

Found out and fixed the problem with the fixed topology network - a reward was being added to the total which probably caused the short-term (but bad in the long-term) solutions to "blossom" and which spread their weights/biases to the other offspring. In other words, if a genome initially gets a good score, even though it later performs not as good as it did in the beginning, its score will get accumulated and its weights gonna spread out to children (epidemic). I now reset the score since accumulation of score of a genome each step of evolution.