Why got some OOV for testing?

yandex / faster-rnnlm

Faster Recurrent Neural Network Language Modeling Toolkit with Noise Contrastive Estimation and Hierarchical Softmax

Other

561 stars 138 forks source link

Why got some OOV for testing? #44

Open wolfshow opened 7 years ago

wolfshow commented 7 years ago

I train the model on millions of sentences, when testing, I found some OOV for the whole sentence but the sentence is just simple as "you 're not .", Anyone knows why?