Any ideas on how to implement Self-Normalizing Activation (SNA) function? #Question

nschaetti / EchoTorch

A Python toolkit for Reservoir Computing and Echo State Network experimentation based on pyTorch. EchoTorch is the only Python module available to easily create Deep Reservoir Computing models.

https://nschaetti.github.io/echotorch.github.io/

GNU General Public License v3.0

441 stars 117 forks source link

Any ideas on how to implement Self-Normalizing Activation (SNA) function? #Question #25

Closed chrisotoro closed 2 years ago

chrisotoro commented 2 years ago

I'm curious if anyone has attempted to adapt the SNA from this paper to work with EchoTorch: https://www.iccs-meeting.org/archive/iccs2021/papers/127420093.pdf

Their Github: https://github.com/Ro6ertWcislo/AutoESN

It seems like a potentially worthwhile tool.