kuroko-lang / kuroko

Dialect of Python with explicit variable declaration and block scoping, with a lightweight and easy-to-embed bytecode compiler and interpreter.
https://kuroko-lang.github.io/
MIT License
431 stars 25 forks source link

Fix one-way mappings for half-width katakana to fullwidth when encoding web-version ISO-2022-JP #9

Closed harjitmoe closed 3 years ago

harjitmoe commented 3 years ago

I had switched it ages ago to access the JIS X 0208 mappings in both directions for ISO-2022-JP as a wrapper around the EUC-JP mappings (clearing the high bits and constraining the lead bytes), to avoid using up disk footprint with an essentially redundant set of tables. I didn't quite realise that this meant its encoder half was no longer using the WHATWG-specified index iso-2022-jp-katakana one-way mappings for the halfwidth katakana to their fullwidth counterparts.

This alters gen_dbdata.krk again to fix that.