Currently, we only use a [PEG Pest] grammar in grammar.pest without any lexing / tokenization step to parse files.
For a number of reasons, it would be a good idea to introduce a lexing step.
Especially for a grammar which only parses import statements, the grammar is already complex.
There is some evidence that a lexer-parser pipeline can be more efficient thank doing lexical analysis in the parser (given that grammar parsing algorithms are overkill for tokenization)
Currently, we only use a [PEG Pest] grammar in grammar.pest without any lexing / tokenization step to parse files.
For a number of reasons, it would be a good idea to introduce a lexing step.