Performance tune activation functions

colgreen / sharpneat

SharpNEAT - Evolution of Neural Networks. A C# .NET Framework.

https://sharpneat.sourceforge.io/

Other

388 stars 100 forks source link

Performance tune activation functions #63

Closed colgreen closed 3 years ago

colgreen commented 3 years ago

See the recent performance tuning tweaks made to:

SharpNeat.NeuralNets.Double.ActivationFunctions.Vectorized.LeakyReLU

for hints.

Consider if any there are any per tuning opportunities for the scalar implementations - these are the ones that are currently used as they actually run faster for the neural net topologies that tend to get evolved, i.e, .highly irregular connectivity.

colgreen commented 3 years ago

Done.