no-context / moo

Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.
BSD 3-Clause "New" or "Revised" License
814 stars 65 forks source link

Example in Markdown file is misleading, WS definition is wrong #161

Closed fredericbahr closed 2 years ago

fredericbahr commented 2 years ago

The the WS rule from the markdown example is misleading. If you use this rule the lexer will not correctly recognize the column number cause it treats a tab as one character and not as 2 or 4. This is misleading when it comes to providing detailed error information at which position an error occured.