search

brendano / ark-tweet-nlp

CMU ARK Twitter Part-of-Speech Tagger
http://www.ark.cs.cmu.edu/TweetNLP/
Other
575 stars 199 forks source link

Use POS without tokenizer #43

Open Maathuis opened 7 years ago

Maathuis commented 7 years ago

Dear,

The tokenizer does a great job however it does not suit my needs for the task I have at hand. Is it possible to run only the POS tagger without the tokenizer? If so how should I approach this?

Kind regards, Henry

yuchenlin commented 7 years ago

You just need to modify the java code to skip the tokenization step, then re-complie the jar and finally replace the old one with your new jar.