To be able to scan for tokens that aren't static "keywords" (like ordered lists starting with 1., 2., etc.), we probably need to alter the lexer to match against regexes instead of exact strings. This isn't a huge lift, and it should fit well with the existing structure of the lexer.
To be able to scan for tokens that aren't static "keywords" (like ordered lists starting with
1.,2., etc.), we probably need to alter the lexer to match against regexes instead of exact strings. This isn't a huge lift, and it should fit well with the existing structure of the lexer.