search

keras-team / keras-core

A multi-backend implementation of the Keras API, with support for TensorFlow, JAX, and PyTorch.
Apache License 2.0
1.27k stars 117 forks source link

Add `mish` activation to keras_core.ops.nn #711

Closed Frightera closed 1 year ago

Frightera commented 1 year ago

TensorFlow and Pytorch have it implemented, JAX does not have it though. Is it still worth adding this activation function? Should be a one-liner in JAX too.

It has 1405 citations: Mish: A self regularized non-monotonic activation function

fchollet commented 1 year ago

We already have it in keras.activations -- no clear need to have it in ops.nn IMO.