timtadh / lexmachine

Lex machinary for go.
Other
405 stars 28 forks source link

Stream scanning #26

Open timtadh opened 6 years ago

timtadh commented 6 years ago

This PR will add support for scanning a byte stream instead of needing to read in the entire file. Note, because of how lexical analysis lookahead works in rare cases you still might need to read in the whole file. However, this will help many common cases.

This is not finished.