search

cenotelie / hime

Apache License 2.0
27 stars 4 forks source link

Handling of incorrect UTF-16 sequences in the lexers #25

Closed woutersl closed 9 years ago

woutersl commented 9 years ago

Original report by Laurent Wouters (Bitbucket: 557058:675792b6-d731-4823-9f7d-c6dfcb2df2b5, ).

Currently, the lexers assume correct UTF-16 encoding sequences.

woutersl commented 9 years ago

Original comment by Laurent Wouters (Bitbucket: 557058:675792b6-d731-4823-9f7d-c6dfcb2df2b5, ).

[fix] Fixed issue #18 and #25 by the implementation of the fuzzy DFA matcher used on lexical errors