Closed retorquere closed 4 months ago
Hi @retorquere
Thanks for writing to us.
Both the special cases highlighted by you are noted to be taken up in next release of fixes.
Best, Rachna
The release made for winkjs/wink-nlp#135 did not yet include this, correct?
Yes, will be initiating the work on the remaining two soon.
'Poincar\u00e9'
gets shape'Xxxxxé'
instead of'Xxxxxx'
, and"Poincare\u0301"
(which is just the NFD form of the former) is tokenized as two tokens ('Poincare'
and'\u0301'
).