Open yurug opened 5 years ago
This is, as of today, still the case. It has to do with the fact that Morbig, once it has delimited a token, only knows the position of the delimiter, and not the token itself. It would require a form of "position-aware" token buffer.
The column numbers of starting position are still wrong, as demonstrated by the following example:
which produces the following JSON for the word
true
: