Closed Robotuks closed 6 years ago
Hey,
I wanted to ask about calculation in sample function.
sample
return tf.argmax(tf.log(u) / probs, axis=1)
it divides from probs. Does that mean that lower probabilities have better chances to get picked? Better exploration???
probs
log(u) makes it negative. So everything is fine. But probs can be equal to 0, no?
0
@Robotuks I think I ensure probs are never actually 0 somewhere (it's kind of a hack, but hey it works)
Hey,
I wanted to ask about calculation in
sample
function.return tf.argmax(tf.log(u) / probs, axis=1)
it divides from
probs
. Does that mean that lower probabilities have better chances to get picked? Better exploration???