search

pfnet-research / menoh

Menoh: fast DNN inference library with multiple programming language support
MIT License
279 stars 34 forks source link

Improve sigmoid #190

Closed Hakuyume closed 5 years ago

Hakuyume commented 5 years ago

Subtracting maximum element does not have any good effects on stability because Sigmoid is an element-wise operator. Unlike Softmax, It does not require sum of exps.

okdshin commented 5 years ago

I see. Thank you. I will merge.