search

project-langx / X

A placeholder language with shareable bytecode IR.
2 stars 0 forks source link

Support new grammar in tokenizer #2

Closed frankhart2018 closed 3 years ago

frankhart2018 commented 3 years ago

The new grammar is (or will be supported - #1) only in the parser. Add support for the same in the tokenizer.