search

nytud / hunlp-GATE

Lang_Hungarian - a GATE plugin containing Hungarian NLP tools as GATE processing resources
GNU General Public License v3.0
8 stars 6 forks source link

HFSTMorphAndLemma to use take the token from the tokenizer's output #12

Open DavidNemeskey opened 7 years ago

DavidNemeskey commented 7 years ago

Proof-of-concept fix for #10. Unfortunately PurePos, the next module in line, also takes its input from the original text, so the solution is not fully consistent at this stage.

sassbalint commented 7 years ago

Do not merge this, please, until I review it.