Closed rtfeldman closed 10 years ago
Refactored lexer in support of removing let (which is almost there; 1 failing test cases remaining due to where).
let
where
The main changes are:
chunk
tokenise
exports.tokenise
This is a big enough change to a critical piece of code that I figured a PR would be appropriate.
Any objections to merging this in?
I'm game.
Refactored lexer in support of removing
let
(which is almost there; 1 failing test cases remaining due towhere
).The main changes are:
chunk
, so we can process a substring ofchunk
instead of the whole thing.tokenise
function that can be used outside the mainexports.tokenise
.This is a big enough change to a critical piece of code that I figured a PR would be appropriate.