search

dylan-hackers / mindy

Mindy - minimal compiler-interpreter for Dylan
Other
21 stars 9 forks source link

Unicode support #66

Open waywardmonkeys opened 8 years ago

waywardmonkeys commented 8 years ago

We need to think about Unicode support in Mindy.

My initial proposal would be that binary data be moved to a new byte buffer type (or byte vector) ala #57.

Then, we'd treat all strings as UTF-8 and provide ways to encode to and decode from a byte buffer.

We would get rid of <unicode-string> and perhaps <byte-string> and have a single subclass of <string> that provided the UTF-8 functionality.

waywardmonkeys commented 8 years ago

It might be worth taking a look at https://bitbucket.org/knight666/utf8rewind/overview