modern-fortran / neural-fortran

A parallel framework for deep learning
MIT License
409 stars 85 forks source link

add CELU activation function #143

Closed pablomazo closed 1 year ago

pablomazo commented 1 year ago

Hi.

This PR implements a new activation function, CELU, which i need for a personal project and may be worth having it here.

It follows the Pytorch implementation and here is the paper where it is proposed: https://arxiv.org/abs/1704.07483

Hope this can be helpful.