search

iwillspeak / ullage

A statically-typed compiled language defined by a simple grammar
http://willspeak.me/ullage/
Other
23 stars 1 forks source link

Tokenisation & AST Metadata #8

Closed iwillspeak closed 6 years ago

iwillspeak commented 7 years ago

Update the token iterator to add position metadata to each token. Update to the expression tree produced by the syntax module to expose position metadata and raw tokens too.