Consider using runes for lexing

Draco-lang / Compiler

The compiler repository for the Draco programming language.

Apache License 2.0

100 stars 8 forks source link

Consider using runes for lexing #204

Open LPeter1997 opened 1 year ago

LPeter1997 commented 1 year ago

The BCL has had Unicode capabilities quite a while ago in the form of Runes. We should consider using runes for lexing to properly handle characters that don't fit into UTF16.

WalkerCodeRanger commented 7 months ago

What is this issue about? Is "Runes" a tool or a technique? Can you provide a link?

LPeter1997 commented 7 months ago

Updated the original issue with a short description @WalkerCodeRanger