congo-cc / congo-parser-generator

The CongoCC Parser Generator, the Next Generation of JavaCC 21, which in turn was the next generation of JavaCC
https://discuss.congocc.org/
Other
36 stars 11 forks source link

Add matcher hook to allow injection of token matching logic #50

Closed adMartem closed 1 year ago

adMartem commented 1 year ago

This will allow me to experiment with DFA lexing which results in a sometimes dramatic improvement in parsing time for some worst-case COBOL source programs (parse times 50% of NFA times). In typical cases the improvement is less significant (parse times 70 to 90% of NFA times). The DFA lexing time is usually about 30-50% of the NFA lexing time.