search

Klebert-Engineering / simfil

The Simple Map Filter Language Interpreter 🌳.
BSD 3-Clause "New" or "Revised" License
6 stars 0 forks source link

Parser does not play well with Umlaut characters. #95

Open josephbirkner opened 1 month ago

josephbirkner commented 1 month ago

Currently, Umlaut characters seem to throw off the parser. E.g.: image

Or: image

johannes-wolf commented 1 month ago

Maybe we can use https://github.com/uni-algo/uni-algo for codepoint properties & normalization.

johannes-wolf commented 3 weeks ago

Clarification: The parser has no problem handling umlaut characters, but does not allow any [^_a-zA-Z0-9] characters in identifiers.

Improving the error message or allowing Unicode identifiers would fix this minor issue.