Closed chaoming0625 closed 8 months ago
It seems that threshold needs to be divided by beta “return jnp.where( x > threshold/beta , ...” , based on the description of softplus "input X beta > threshold"
Exactly. Currently, the algorithm is:
jnp.where(x * beta > threshold, x, 1 / beta * jnp.logaddexp(beta * x, 0))
Thanks for the suggestion.
580