koka-lang / koka

Koka language compiler and interpreter
http://koka-lang.org
Other
3.16k stars 151 forks source link

Fix unicode issue #461

Open TimWhiting opened 5 months ago

TimWhiting commented 5 months ago

Fixes: #458 & #457

There is more work to do to grapheme clusters completely correct, but this is a step in that direction.

See https://www.unicode.org/reports/tr29/#Grapheme_Cluster_Boundary_Rules for what needs to be done to support this properly.

erf commented 5 months ago

i think the latest Unicode version in use is 15.1 (16 is in draft)

https://www.unicode.org/Public/UNIDATA/EastAsianWidth.txt

TimWhiting commented 5 months ago

i think the latest Unicode version in use is 15.1 (16 is in draft)

https://www.unicode.org/Public/UNIDATA/EastAsianWidth.txt

Thanks for the pointer to a link that doesn't have a hard-coded version in it. I've created a python script so we can make updating this part of our release process.

erf commented 5 months ago

I'm making a script like that myself for my Dart vi-like editor vid . BTW beware the format has changed slightly with the "W" in a different place

TimWhiting commented 5 months ago

I came from the Dart community myself 😄. Glad to see that other people have found Koka.

erf commented 5 months ago

It seems like a great language I'd like to explore ! Although it might still be in a early stage in regards of libraries etc.

TimWhiting commented 5 months ago

It seems like a great language I'd like to explore ! Although it might still be in a early stage in regards of libraries etc.

Yes it is. Libraries can't be done alone though; they require a community. We are getting more active at accepting contributions. I hope you can see the potential for Koka to grow, and become part of the community - at least as an enthusiast, even if it isn't your day job yet :).

TimWhiting commented 5 months ago

One difficult thing about Koka and creating the standard libraries is that Koka includes a bunch of non-standard features that directly affect api design. We are still learning what idiomatic Koka code looks like. You can help with that :).

erf commented 5 months ago

I definitely can see the potential, although I've only recently started looking into it. I do have a lot of things going on right now, so not sure how much i can contribute at the moment, but will keep an eye on it. In my experience building a community requires a strong leader - especially in the initial phase. Keep up the good work :)