search

openai / finetune-transformer-lm

Code and model for the paper "Improving Language Understanding by Generative Pre-Training"
https://s3-us-west-2.amazonaws.com/openai-assets/research-covers/language-unsupervised/language_understanding_paper.pdf
MIT License
2.15k stars 503 forks source link

Using it as a Language model #37

Open mdasadul opened 5 years ago

mdasadul commented 5 years ago

was trying to use it as a language model to assign a score(could be PPL score) of a given sentence. Something like P("He is go to school")=0.008 P("He is going to school")=0.08 Which is indicating that the probability of second sentence is higher than first sentence. Is there a way to get a score like this?

Thanks