colgreen / sharpneat

SharpNEAT - Evolution of Neural Networks. A C# .NET Framework.
https://sharpneat.sourceforge.io/
Other
388 stars 100 forks source link

Saved genome provides consistent result that don't match the ones it got during training #83

Open voiceofthedead opened 2 months ago

voiceofthedead commented 2 months ago

The problem is mostly covered in the title. I've trained a genome on a specific set of data, but when I connect the library into a different project and try to backtest it on the same set of data, the results are consistent from run to run, but don't match the one that occurred during the learning process. Any suggestions on how could that come about ?

colgreen commented 2 months ago

Is it a cyclic/recurrent network, or an acyclic net?

voiceofthedead commented 2 months ago

It's set as acyclic in the config file

colgreen commented 2 months ago

I wonder - does your fitness function have state that needs resetting?

voiceofthedead commented 2 months ago

It did at some point, but I figured out that it caused an issue, so now everything that's going to be changed in the process of calculating fitness is populated at the beginning of RunTrial and stored locally in the method, so not anymore

voiceofthedead commented 2 months ago

Any other ideas perchance ?

voiceofthedead commented 2 months ago

Switching to cyclic didn't influence the issue btw