minimaxir / textgenrnn

Easily train your own text-generating neural network of any size and complexity on any text dataset with a few lines of code.
Other
4.94k stars 752 forks source link

Calculating "Perplexity" and "Accuracy" of model #168

Open hmdgit opened 4 years ago

hmdgit commented 4 years ago

Hi,

I would like to calculate "perplexity" and "accuracy" of my trained model. Is there any way to do that?

avh77 commented 4 years ago

You can find the answer here: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0084217