Open tnowacki opened 2 years ago
I will do that! I have a parser written for unicode chars!
@tnowacki checkout, I have filtered most useless unicode in my last parser → https://github.com/sap-lang/sap-lang/blob/master/src/utils.rs
We probably don't want unicode characters anywhere but in comments. I'll take a look though when we get to this, thanks!
As mentioned in #18, we are very restrictive in our character sets today. We had discussed relaxing this late last year, but made no changes yet. We should open up the character sets and give warnings where we think it might be applicable