Closed ldez closed 8 years ago
I didn't know about the tokenizeLine
vs tokenizeLines
, although I noted both to be available. Good catch. I assume this is ready for merge (as all the boxes are ticked?) I'll give it a try.
Ran a couple of practical tests. Very nice improvements, none of which seem to be a breaking change. I'm up for a merge.
Merged!
Note: I use
grammar.tokenizeLines
in the tests becausegrammar.tokenizeLine
doesn't work properly with multi-lines content.grammar.tokenizeLine
give false positive with multi-lines because it parse multi-lines as a single line.Fix #20, #39, #59