search

Dervall / Piglet

An easier to use parsing and lexing tool that is configurable in fluent code without a pre-build step.
binarysculpting.com
MIT License
91 stars 11 forks source link

Improve performance of NFA lexing #52

Open Dervall opened 11 years ago

Dervall commented 11 years ago

NFA lexer construction is incredibly fast, but the execution is painfully slow. This is due to the closure algorithm being executed lots of times during the lexing. This could be avoided.

Create some tests that shows the poor performance of the runtime

Cache closure results for given state sets.

Probably improve the character range searches as well