nytud / hunlp-GATE

Lang_Hungarian - a GATE plugin containing Hungarian NLP tools as GATE processing resources
GNU General Public License v3.0
8 stars 6 forks source link

HFST doesn't recognize unicode #29

Open ReturnToInteger opened 3 years ago

ReturnToInteger commented 3 years ago

I only installed the hfst plugin and then used the java wrapper by running hfst-wrapper with the given command, but I run into issues because it replaces accented letters with a ?, and doesn't properly analyze the words. It can lemmatize the words correctly, but it doesn't seem to support unicode.