openpeeps / toktok

Generic tokenizer written in Nim language 👑 Powered by std/lexbase and Nim's Macros
https://openpeeps.github.io/toktok/
MIT License
31 stars 0 forks source link