Factor out Matcher - Githubissues

no-context / moo

Optimised tokenizer/lexer generator! 🐄 Uses /y for performance. Moo.

BSD 3-Clause "New" or "Revised" License

817 stars 65 forks source link

Factor out Matcher #104

Closed tjvr closed 5 years ago

tjvr commented 5 years ago

Factor out a Matcher class, that contains all the matching logic. The Lexer knows how to turn a Match into a token, and manage states etc.
Use a Token class, instead of plain objects.

tjvr commented 5 years ago

The Matcher change appears to make compilation ~8% slower, and lexing 5-8% slower. I'm not entirely sure why; I would have expected V8 to do a good job optimising and inlining this code.