added mask option for evaluators; added xent runner; added PerplexityEvaluator

ufal / neuralmonkey

An open-source tool for sequence learning in NLP built on TensorFlow.

BSD 3-Clause "New" or "Revised" License

410 stars 106 forks source link

added mask option for evaluators; added xent runner; added PerplexityEvaluator #801

Closed varisd closed 5 years ago

varisd commented 5 years ago

CrossEntropyRunner (returns xents computed in train_xents method)
removed PerplexityRunner
PerplexityEvaluator (computes perplexity based on list of partial or per-token cross entropies)
mask option for evaluators (tokens evaluated against masked referential tokens will be ignored)

varisd commented 5 years ago

Asi se dá vyhodit AverageEvaluator, pokud ještě existuje - ten byl kvůli těm perplexitám. Nebo se dá přinejmenším vrazit do jednoho modulu s tim perplexity evaluatorem.

AverageEvaluator jsem zatim nechal.