search

NVIDIA / OpenSeq2Seq

Toolkit for efficient experimentation with Speech Recognition, Text2Speech and NLP
https://nvidia.github.io/OpenSeq2Seq
Apache License 2.0
1.54k stars 372 forks source link

Is clipped ReLU used in Jasper? #486

Closed vadimkantorov closed 4 years ago

vadimkantorov commented 4 years ago

https://nvidia.github.io/OpenSeq2Seq/html/speech-recognition/jasper.html says that Clipped ReLU is used. However in the source code it's just "activation_fn" : tf.nn.relu

Thanks!

borisgin commented 4 years ago

We use regular ReLU, clipped ReLU is optional

vadimkantorov commented 4 years ago

thanks!