aboSamoor / polyglot

Multilingual text (NLP) processing toolkit
http://polyglot-nlp.com
Other
2.3k stars 337 forks source link

Erroneous POS tagging #145

Open devikasondhi opened 6 years ago

devikasondhi commented 6 years ago

Hello, The pos tagger doesn't seem to handle cases with possessive markers correctly (like 's). Failed example: Text("John's big idea isn't all that bad.").pos_tags Got: [("John's", 'NUM'), ('big', 'ADJ'), ('idea', 'NOUN'), ("isn't", 'CONJ'), ('all', 'DET'), ('that', 'DET'), ('bad', 'ADJ'), ('.', 'PUNCT')]

Here John's is tagged as NUM, isn't that incorrect?