search

SmaCCRefactoring / SmaCC

Smalltalk Compiler Compiler : a parser generator
Other
32 stars 15 forks source link

SmaCC should warn than a token character is removed #35

Open ThierryGoubier opened 7 years ago

ThierryGoubier commented 7 years ago

When we limit (by default) characters to the 0-255 range, then a regular expression containing characters above 255 (Unicode instances) will see those characters silently disappear. So:

<arrow> : -> | → ;

will silently become:

<arrow> : -> ;

The → character alternative will disappear

ThierryGoubier commented 7 years ago

Fix will be temporary: Unicode support has to be reimplemented anyway.