Closed TimZaman closed 5 years ago
Entropy seems extremely low here.. e.g.
{'enum': tensor([[[5.0860e-09, 5.1802e-09, 1.0000e+00]]], grad_fn=<SoftmaxBackward>),
'target_unit': tensor([[[1.6518e-06, 4.9796e-23, 6.7985e-24, 6.7985e-24, 6.7985e-24,
6.7985e-24, 9.2425e-01, 1.3570e-05, 7.5734e-02, 3.8476e-21,
3.8476e-21, 3.8476e-21, 3.8476e-21, 3.8476e-21, 3.8476e-21,
3.8476e-21, 3.8476e-21, 3.8476e-21, 3.8476e-21, 3.8476e-21,
3.8476e-21, 3.8476e-21, 9.0723e-19, 4.3352e-19, 3.9908e-14,
2.5837e-28, 7.8423e-27, 1.2303e-21, 1.2303e-21, 1.2303e-21,
1.2303e-21, 1.2303e-21, 1.2303e-21, 1.2303e-21, 1.2303e-21,
1.2303e-21, 1.2303e-21, 1.2303e-21]]], grad_fn=<SoftmaxBackward>),
Fixed, added an eps for now.
Probably due to action masking, but at the core probably a pytorch bug.