Closed sveinbjornt closed 3 years ago
Support has been added.
Þetta var notandinn @matur.a.mbl á Twitter.
now becomes
{"k":"BEGIN SENT","t":""}
{"k":"WORD","t":"Þetta","o":"Þetta","s":[0,1,2,3,4]}
{"k":"WORD","t":"var","o":" var","s":[1,2,3]}
{"k":"WORD","t":"notandinn","o":" notandinn","s":[1,2,3,4,5,6,7,8,9]}
{"k":"USERNAME","t":"@matur.a.mbl","v":"matur.a.mbl","o":" @matur.a.mbl","s":[1,2,3,4,5,6,7,8,9,10,11,12]}
{"k":"WORD","t":"á","o":" á","s":[1]}
{"k":"WORD","t":"Twitter","o":" Twitter","s":[1,2,3,4,5,6,7]}
{"k":"PUNCTUATION","t":".","v":".","o":".","s":[0]}
{"k":"END SENT","t":""}
The following text
becomes