Add softsign activation.

mila-iqia / blocks-extras

A collection of extensions to the Blocks framework

MIT License

27 stars 40 forks source link

Add softsign activation. #48

Closed dwf closed 8 years ago

dwf commented 8 years ago

I can't imagine anyone has any objections to this. Since it's an activation used in several MILA papers, maybe it should go in Blocks itself, but it should definitely be in either Blocks or here.

rizar commented 8 years ago

Sorry for the delay, wanted to say LGTM yesterday, but forgot.