Fix computation of perplexity

ufal / neuralmonkey

An open-source tool for sequence learning in NLP built on TensorFlow.

BSD 3-Clause "New" or "Revised" License

410 stars 106 forks source link

Closed jlibovicky closed 5 years ago

jlibovicky commented 5 years ago

There were two issues with the perplexity evaluator:

it crashed during validation because the list of hypotheses consisted of batches of different length and numpy was not able to convert it to np.array and np.mean crashed
it did not take into account masking and included padded position with xent of 0.0 into the mean