colgreen / sharpneat

SharpNEAT - Evolution of Neural Networks. A C# .NET Framework.
https://sharpneat.sourceforge.io/
Other
380 stars 97 forks source link

Fast ReLU using bitwise operators #77

Closed ziachap closed 1 year ago

ziachap commented 1 year ago

Here's an implementation of ReLU that I found to be around 4x faster than the default ReLU in my own benchmarks.

colgreen commented 1 year ago

Thanks for the PR. It's an interesting approach that can probably be used in multiple other places.